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ABSTRACT 

This is an evaluation of a project whose expressed 
purpose is to teach "abstract conceptually-oriented" mathematics to 
disadvantaged elementary school children using a discovery-oriented, 
pattern-recognition approach. This report is primarily of Project 
SEED (Special Elementary Education for the Disadvantaged) in Gary, 
Indiana during 1970-72. It attempts to evaluate the affective impact 
on children and the impact on the teachers' behavior; instrument 
construction in support of these evaluation areas is discussed. 
General conclusions are that students with SEED instruction do 
somewhat better in mathematics and that most like the program. There 
is no clear-cut evidence that this instruction has a significant 
effect on the child's general self-concept or that it has a lasting 
impact on the regular teachers' behavior. A serious problem remains 
concerning educational priorities and cost effectiveness of the 
project. (LS) 
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BRIEF HISTORY OF PROJECT SEED 



In order to provide context for this evaluation report and for the 
project that it reports on, a brief history of Project SEED will be given. 
The founding of Project SEED (Special Elementary Education for the Dis- 
advantaged) is generally attributed t: William F. Johntz. In 1963 Johntz, 
who was a high school mathematics teacher in ^^erkeley, California, took his 
lunch hours to teach mathematics to disadvantaged (mostly black) elementary 
school children. Since then Johntz has made a serious effort to generalize 
his success by getting others who have a strong mathematics background to 
teach "abstract conceptuany-on*ented"'"nrathematics to disadvantaged children. 

The rationale behind SEED was very much a product of the times. The 
writings of Jerome Bruner were being widely read by educators. The Cambridge 
Conference on School Mathematics had just published its "Goals for School 
Mathematics". The idea, in particular, that the fundamental concepts of any 
subject could be taught to children at any level if properly presented had 
caught the fancy of a number of mathematicians, mathematics teachers and mathe- 
matics educators. 1963 was also a year in which racial tensions had reached 
a very serious level. By this time vocational or remedial education for 
blacks had fallen into disrepute. Some claimed that society was unwittingly 
(or otherwise) using the schools to keep the poor, poor. The rationale behind 
Project SEED was that a child's performance in school is a product of a complex 
of forces including the child's cultural background and self-concept. Many 
children from disadvantaged backgrounds lacked the language skills, experience 
and motivation to function successfully in school. The failure that they 
experienced reinforced their own low expectations for themselves. Most 
remedial work tended to be "revisiting past sins" and did little to promote 
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success in new undertakings. Abstracti conceptually-oriented mathematics 
was judged to be culture free, to have high prestige value and to be 
teachable from first principles using a discovery-oriented, pattern-recog- 
nition approach. The SEED approach is to teach abstract mathematics using 
guided discovery. Fundamental to SEED is a flexible curriculum in which a 
child's Ideas can be pursued as having value. Also of great Importance is 
positive reinforcement. Wrong answers are not to be labeled as such. 
Instead, they are to be either deflected or pursued to uncover the question 
that might underlie to which the answer was a correct response. Over the 
years an assortment of teaching techniques, devices and gimmicks have come 
to be associated with Project SEED, Hand and finger signals for various 
messages such as "can*t be done" and "wrong" as well as signals for various 
numerical answers seem to help generate pupil motivation and lend a distinc- 
tive flavor to SEED classes. It was clear that classes of this kind could 
only be conducted by someone knowing sufficient mathematics to be comfort- 
able and confident in a free-wheeling classroom in which a lesson might go 
in any direction. So the model that evolved was that of a trained mathema- 
tician teaching abstract, conceptually-oriented mathematics via a guided 
discovery technique to disadvantaged elementary school children in hope of 
improving their self expectations, self image, school achievement, and 
ultimately their prospects for success in life. The SEED class is typically 
taught for 40 minutes a day, four days a week and is regarded as being a 
supplement to, rather than a replacement for regular mathematics instruction. 

A number of SEED classes evolved in the Berkeley area, many of which 
were manned by mathematics graduate students at the University of California. 
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In addition SEED Projects of various kinds developed throughout the 
country. A brief description of some of those follows. 

In 1967 the legislature of the State of California passed a bill 

j 

authorized by Senator George Miller, Jr., for h program to improve mathe- 
matics insturction in the California public schools. The bill provided 
funds for what came to be known as the Miller Mathematics Improvement 
Program. The program has several projects, one of which was called the 
Mathematics Specialist Project and provided funds to school districts 
throughout the state to hire mathematics specialists to teach classes that 
wer^j modeled after the SEED classes in Berki^ley. (The evaluation of this 
project is reviewed in the section entitled "Other Evaluations of SEED 
Projects".) A similar program called the Community Teaching Fellowship 
Program was funded through the eight campuses of the University of 
California. 

Another major SEED Project evolved in Michigan. It started, as have 
many, with Johntz putting on a demonstration of his technique with children 
from a nearby elementary school; some local mathematicians taking over the 
demonstration class and other classes; and these mathematicians then 
seeking funds to expand and continue SEED. In the case of Michigan, the 
state legislature voted in 1970 to contract with Project SEED to provide 
SEED instruction in various classrooms throughout the state. 

There are, or have been, SEED classes in California, Michioan, 

Alas;ka, New York, New Jersey, and Indiana to name a few states. Bell Tele- 

i 

phone Laboratories and I.B.M. have provided released time for their employees 
to teach SEED classes. 
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In February 1970 two SEED classes were started in Bloomlngton, 
Indiana. One taught by a faculty member and one by a graduate student 
in the mathematics department at Indiana University. A state-wide conmittee 
v/as formed to determine what role Indiana University should play in en- 
couraqinq Project SEED in Indiana. The Committee visited the SEED Project 
in Ypsilanti, Michigan, and communicated with other SEED Projects. As a 
result of the Committee's recommendations the Indiana University Foundation 
provided funds for faculty released time and graduate student salaries for 
SEED instruction in Gary and Bloominqton. The fiary SEED Project also 
received funds from both the School City of Gary and from the National Science 
Foundation, and the Blooming ton SEED project received funds from the Monroe 
County Community School Corporation. 

A note of clarification is probab'!y in order concerning responsibility 
for the control of SEED projects. In this report the phrase "SEED project" 
is beinn applied to «ny instructional program which is modeled after the 
original Berkeley SEED project. Most of these projects, including the Gary 
Project maintain little or no ongoing connection with the Berkeley project. 
However, a few, e.g. the Michigan project, have remained in direct contact. 
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BACKGROUND FOR THIS EVALUATION 

This rei'Ort is of the Gary SEED Evaluation Project which is a 
result of a proposal by the director of the Bloomington SEED Project to 
evaluate Project SEED in Indiana. By the time; of funding, the Gary SEED 
Project was the only SEED activity in Indiana, so the evaluation was 
focused there. A brief history of the Gary SEED Project follows. 

The statewide committee appointed by the Indiana University 
Foundation arranged a demonstration of the SEED teaching approach which was 
given on May 8, 1970 at Indiana University Northwest 1n Gary. Subsequent 
to that demonstration funds were granted by the Indiana University Founda- 
tion and the School City of Gary for a SEED project to be held in certain 
Gary schools. Some pilot evaluation activities were carried on during that 
1970-71 project and arc reported below. 

For the 1971-72 year funding was received from the National Science 
Foundation as well as from the School City of Gary to continue SEED teaching 
activities and to conduct this evaluation. In the summer of 1971 a workshop 
for teachers v/as held which focused on discovery-oriented teaching of high 
school algebra to elementary school children. Then, in addition to the 
regular SEED classes during the school year, weekly workshops were held for 
the homeroom teachers in these classes. In these workshops an effort was 
made to help the teachers plan laboratory-type activities to enhance the 
teaching in their "regular" mathematics lessons. At the end of the 1971-72 
academic year all SEED instructional activities in Gary were ended. More 
details of the Gary SEED Project are contained in the description of the 
treatment. 
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The Gary SEED Evaluation Project reported on hero was funded by 
the National Science Foundation in the spring of 1971 to expand and 
continue evaluation efforts that had already been begun by the Gary SEED 
Project. There are two aspects of the Evalur-^tion Project, the evaluation 
aspect and the instrument construction apsect. The evaluation aspect has 
two parts, the evaluation of the affective impact of SEED instruction on 
children and the evaluation of the impact of SEED instruction on the 
teaching behavior of the home room teacher. The instrument construction 
aspect was partly in support of the evaluation aspect and partly in 
response to the discovered need for affective self-evaluation instruments 
that are closely tied to specific school content areas. The untimely 
closing of the Gary SEED Project in 1972 prevented the full use in the 
evaluation of some of the instruments that were developed and validated. 



OTHER EVALUATIONS OF SEED PROJECTS 



During the last five years Project SEED has undergone several 
evaluations, both formal and informal. These evaluations have ranged 
from a direct observation of a single class session through a sustained 
and elaborate evaluation using more sophisticated instruments to 
measure achievement to a longitudinal study which tried to measure 
student achievement and attitudinal change over a longer period of 
exposure to SEED teaching. 

As regards direct observations of SEED classes by various individ- 
uals. Project SEED has fared well. The experience of watching supposedly 
disadvantaged children respond to\athematics which is normally regarded 
as being years beyond '^hem has caught the fancy of many. 

Most of the informal evaluations are general istic reports of 
journalists and in some cases university mathematicians or scientists who 
found SEED'S discovery method of learning-teaching mathematics exciting. 
For instance Professor George E. Backus, Professor of Geophysics at 
University of California at San Diego after attending Mr. Oohntz's 
demonstration of the techniques he used to teach algebra to second and fifth 
graders at Logan Elementary School on May 9, 1968, observed "To say that I 
was impressed with his results is an understatement. Children with obvious 
language problems responded correctly and enthusiastically, and asked very 
shrewd and insightful questions." He further continues to report my 
direct observations indicate clearly that children do grasp concepts which 
so.ne of my undergraduate mathematics students at M.I.T. were vague about. 



and that the children show a qenuine Intellectual curiosity which I would 
be olad to see more widespread among our graduate students at U.C.S.D/' 
In even more enthusiastic language George A.W. Boehm extols the 
success of the SEED method of teaching mathematics to lower grades In the 
article "How to Teach the Esoteric Mathematical Principle of Infinite Con- 
vernence and Hake Any Sixth Grader Eat It Up," he September/October 
1970 issue of Think , He found in the SEED classes conducted by Warren 
Lefler, a co-v/orker of Ilr. Johntz, "no rules to nemorize, no lectures, no 
drill, drill, drill, drill. Yet disadvantaqed children From first to sixth 
qrades naster math that miqht topple a brioht collene undergrade The 
secret: combine socratic questions with a love of math and a belief in 
kids ... Result: the kids begin believing in themselves." Boehm is also 
a sympathetic critic of the SEED project. For example he senses limitations 
in this method. He writes "teaching SEED-style is not at all easy. The 
teacher must curb his impulse to deliver a lecture when he wants to make a 
point. It is much more effective if he works out a line of questioning that 
leads the children to discover it for themselves." This obviously demands a 
thorough knowledge of the structure of mathematical problems on the part of 
the teacher and an ability to break such problems down into logical steps of 
sufficient simplicity to be understood by the young learners. Obviously 
this demands a different kind of teacher than we happen to have at the moment. 
Moreover, taking a long-term view of the SEED project, Boehm points out that 
"SEED may begin to suffer for want of a standard curriculum. So far most 
teachers concentrate on a few topics that they themselves enjoy and think will 
apoeal to young children. This is all very well for the first year or two, 
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when the main objective is simply to encourage children to think mathe- 
matical ly. But when children change teachers or perhaps schools, they 
may be discouraged if they take up the same concepts for the second or 
third time,'' This calls for a more systematic development of mathematics 
curriculum than the SEED project has been able to evolve, 

Boehm also finds little evidence to show that SEED methodology 
leads to basic attitudinal change. "Although SEED pupils make extra- 
ordinarily rapid progress in arithmetic (actually not taught in the program) 
and in algebra (taught in the proqram) there is no solid statistical 
evidence that they are much better off in reading and other subjects." 

Part of Boehm's criticism was anticipated by Johntz, and this is 
reflected in his attempts to get mathematics specialists involved in the 
project. These specialists came from a wide background. Some like George 
Backus were University professors of mathematics* Others came from 
industrial and business firms. September 1970 issue of IBM-Magazine informs 
us of a number of IBM Research scientists and mathematicians who gave some 
of their own time to a SEED project. Dr. William A. Lester, Jr., a San 
Jose Research chemist who teaches algebra four times a week in San Jose's 
Olinder Elementary School, believes and demonstrates with his other IBM 
colleagues that "the best years for learning abstract mathematics are the 
early years of a student's education, not the ninth or tenth grade." 

Johntz's demonstrations of the SEED techniques have been widely 
reported in many major national newspapers and magazines including Newsweek 
and the New York Times. Most of these journalistic evaluations have tended 
to present the SEED approach and methodology as a radical breakthrough in 
teaching disadvantaged students. 
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There are, however, only two "professional" evaluative studies of 
Project SEED which have effected a degree of methodological sophistication 
and rigor. Both these studies were commisf>ioned by State Departments of 
Education, one in Michigan and one in California, The Michigan Study was 
contracted with the American Institute of Research to conduct an independent 
evaluation of Project SEED in the participating Public Elementary Schools in 
Michigan. The study was conducted during the academic years 1970-71 and 
1971-72. 

The Second Study was done by Professor R.P. Dilworth of California 
Institute of Technology for the California State Board of Education to 
evaluate the Mathematics Specialists Program in the state of California. 
These two evaluation studies will be reviewed below. We also report on a 
third evaluation study of the Community Teaching Fellowship program at 
Berkeley which achieved some interesting results. 

Project SEED in Michigan was evaluated at the end of its first year 
of operation, and a summary of findings was published in October 1971 ^ 
This preliminary study showed that 

1) SEED students generally performed better on the 
standardized arithmetic achievement examination 
(Comprehensive Test of Basic Skills) than compa^^able 
control students. This result was statistically 
significant for fourth and fifth grade students. 
The SEED program seemed to be effective across the 
entire range of student ability and was equally 
effective for boys and girls. 
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2) In qeneral the attitudes of students, classroom 
teachers* principals, and SEED Instructors were 
very favorable to the general impact of the SEED 
program in their schools, more specifically 

a) SEED students in each of the four grades 
reported that they enjoyed their SEED 
class and that they "learned alot!" 

b) Regular classroom teachers of SEED students 
reported that: 

1. Project SEED has been successful in their 
classes^ 

2. They now use the "discovery method" of 
instruction for arithmetic and other 
subjects more frequently than in previous 
years. 

3. Project SEED has improved the motivation 
of their students in arithmetic ♦ 

4. They could identify students who they 
thought were poor students, who because 
of success in SEED classes, have become 
more successful . 

c) Principals of the participating schools also 
had favorable comments regarding stimulating 
student and teacher interest in learning and 
teaching of mathematics. 

O 
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The design of this preliminary study called for a ^'product" . 
evaluation of the outcome of the program and did not try to develop or 
test hypotheses about why the program was more successful in the fourth 
and fifth grades than in the third or sixth, ; 

The 1971-72 study was designed to go beyond the preliminary study 
in terms of developing strategies to measure more adequately achievement 
prior to starting the program for experimental and control groups and 
comparing gains in achievement of students. 

The basic design of the study called for: 

1) Measuring change in arithmetic achievement for 
SEED and control students during the school year. 

2) Assessing attitudes of students, classroom 
teachers, SEED teachers, and orincipals toward 
SEED program. 

3) Obtaining judgements by teachers of their percep- 
tion of the reasons for successful or unsuccessful 
implementation of the SEED program* 

4) Obtaininq judgements of both SEED and classroom 
teachers concerning students who effectively 
utilized SEED and students for whom SEED was 
ineffective. 

The students were tested on the Comprehensive Tests of Basic Skills 
Arithmetic Sections both before and after exposure to SEED programs. 
Different levels of the test were used for different grades. The arithmetic 
subtests used dealt with arithmetic computation, concepts, and applications- 
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A short questionnaire was also administered to both groups of students at 
the time of post-test administration including items related to student 
attitudes towards various school subjects and their reactions to the SEED 
class. The control group was asked about their information regarding the 
SEED class. 

Questionnaires were also administered to the principals, SEED 
teachers and the classroom teachers of both SEED and control classes. 

1 ) The data showed that SEED students on the average 
performed better on a standardized arithmetic 
achievement test than did the control students. 
Gains in achievement (pre-test to post-test) 
indicated that SEED students on the average increased 
their scores more than control students. This was 
primarily due to increased computational skills of 
the SEED students. 

2) Comparisons of arithmetic achievement for students 
with two years of SEED instruction with students 
having experienced only one year of instruction does 
not show marked difference. Therefore there is no 
evidence of positive cumulative effect of SEED teaching. 

3) Another important finding of the study was that as 
measured by the arithmetic achievement test? SEED 
teachers and regular classroom teachers did not discrim- 
inate effectively between students who were profiting 
and students who were not profiting from participation 
in SEED classes. 
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4) Attitudes of the students, teachers, and principals 
as well as SEED Instructors were all very enthusias- 
tic and favorable to the project. 
The data, however, did not specify those aspects of the program 
that were particularly effective in producing the favorable results. This 
specification of causal relationships is yet to be done. Similarly the 
evaluation study points out that, arithmetic achievement of SEED students 
notwithstanding, "behaviorally stated objectives dealing with basic 
attitudinal change need to be specified more clearly to determine the success 
of an innovative education experiment like SEED." 
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Professor Dllworth's evaluation of the Mathematics Specialist 
Project in California was structured around finding significant achieve- 
ment in mathematics learning particularly in the area of whole numbers 
computation, fractions computation, word problems, whole number operations, 
intuitive geometry and pattern recognition. Comparisons were made 
regarding relative achievement of four categories of students, the inte- 
grated, the high percentage black, high percentage Spanish surname and 
low percentage minority groups across all the elementary grades. Compari- 
sons were also made between the experimental groups and a control group on 
a pre-test and post- test basis. The following is selected from the summary 
report of the evaluation. 

"The effectiveness of the use of specialists in teaching mathe- 
matics to elementary school pupils and the degree to which these pupils 
succeeded in learning abstract mathematical concepts were measured in terms 
of the performance of pupils on appropriate pretests and post- tests. These 
examinations were selected and supplied by the State Department of Education 
and were administered to pupils in experimental and comparison classes... 

... Each class taught by a specialist was paired with a class which 
did not receive instruction from a specialist and which, if the district 
size permitted, was in a school in which a specialist did not teach. These 
classes were matched as closely as possible with respect to range of pupils' 
ability, socio-economic backgrounds, urban-suburban-rural characteristics, 
the number of ptjpils from non-Enalish-speakIng homes or ones in which English 
was spoken as a second lanquage, and the mathematics training and exoerience 
of the regular teacher... 
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Pupils who received supplementary instruction from specialists 
durinq the school year performed significantly better on measures of 
mathematical achievement than pupils who did not receive such instruction. 
The greatest amount of growth occurred in the areas of mathematical 
understanding. 

The improvement in performance was greater and included more 
cognitive areas at grades two and three than at the intermediate grades. 
Although the achievement of the experimental classes was generally 
higher than that of the comparison classes at grades five and six, statis- 
tically significant gains were shown only on the pattern recognition 
scale. This scale, however, measures an important cognitive skill in 
mathematics and an area emphasized to a large degree by the specialists 
in their instructional program. 

A statistically significant specialist effect was noted at grade 
five durinn the 1968-69 school year on the measure of material introduced 
specifically in the classes taught by the specialists. Open sentences, 
the inteners, solution sets, order, and graphina were topics included in 
this scale. 

The project was particularly effective in improvina the mathematical 
achieveuent of pupils from disadvantaged regions. Pupils who attended 
schools in which the enrollment of pupils from minority groups was greater 
than 80 percent of the total enrollment (black or a combination of black 
and Spanish surname with black predominant) performed significantly better 
than pupils in the comparison classes. Although the improvement was greatest 
at grade two, the achievement of pupils in the experimental classes at grades 
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three and five was con?>istently higher than that of pupils in classes in 
which specialists did not provide instruction. There was not a sufficient 
number of classes at grade six to accomplish the analysis. 

The Stanford Achievement Test , Primary I and Intermediate I , Form 
Y, Test 2, Paragraph Meaning, was administered to pupils in classes that 
participated in the 1968-69 study. There was no specialist effect at 
either grade two or grade five." 

More recently the Department of Mathematics of the University of 
California at Berkeley undertook a study of the Comnunity Teaching Fellow- 
ship Program. The program provided a daily SEED-like mathematics enrich- 
ment program for the entire academic year to 37 classes in 19 elementary 
schools in 12 districts from Sacramento to San Diego. The study was conducted 
to measure both achievement and attitudinal changes in experimental groups 
of learners. 

The researchers used not only standardized arithmetic tests like 
CTBS and SAT arithmetic W and X intermediate U but also used a specially 
prepared criterion referenced test. This test was designed by mathematicians 
in the program to cover the topics taught during the year. 

To establish a level of difficulty for the criterion referenced test 
a control group of 33 high school students entering the University of 
California at Berkeley Upward Bound program was administered the test. 

The hypothesis was that the fifth grade students in the experimental 
group would have achieved roughly the same level of ca^petence in the items 
on the test as a socio-economically similar group of high school students 
without the benefit of CTF program. The closeness af the means for the two 
groups tends to support the hypothesis. 
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On the standardized tests it was also found that a significantly 
greater percentage of the students in the experimental group gained on 
grade level than those in the control group. j 

The data also reveals that not only significantly larger numbers 
of students showed growth in understanding of mtithematical concepts but 
that very few children were being "turned off" bv* mathematics taught in 
the experimental way. It was shown that when the class receives full CTF 
instruction, there is an actual reduction in the percentage of children 
who are losing ground with respect to grade level. The data shows that 
the students that receive the full CTF instruction i?.lways showed a mean 
growth of more than seven months. 

It seems important to report on one essentially negative commentary 
on Project SEED. This commentary is entitled ''Review of Some Project SEED 
Activities for the New York City Board of Education'*, and it is authorized 
by the (NCTM) Commission on Mathematics Education in the Inner-City. In 
this report the Commission sets out to review a film which had been produced 
by Project SEED. In its indignation over what it feels to be some serious 
misrepresentations in the film, the Commission unfortunately loses some of 
the objectivity and restraint that one might expect. The Commission does, 
however, raise some good questions concerning quality control, priorities, 
cost effectiveness, and goals of Project SEED. These concerns are especially 
noteworthy since they reflect the concerns of a number of professional mathe- 
matics educators as stated to this writer. There is, of course, the natural 
scepticism of professionals toward what they feel are amateurs. But more 
fundamentally there is the belief that Project SEED will not have a profound 



. 19 - 



affect on the basic educational problems to which it addresses itself. 

Finally an interesting but isolated research study was reported 
by Lyndall R. Wirtz, at the University of California at Berkeley, In 
this unpublished study Wirtz found that the SEED treatment siqnificantly 
improved the performance of negro children on Raven's Progressive Matrices 
Test. Wirtz advances this as tentative evidence of weaknesses in Jensen's 
argument that education for the disadvantaged may have to proceed more 
along the lines of associative learning. 

In summary it seems evident from the evaluations that have been 
reported here that Project SEED does have an impact. In each of the field 
evaluations described, SEED students showed significant gains over control 
students on one or more cognitive variables relating to mathematics 
achievement. These results do not speak to questions concerning cost- 
effectiveness nor to precedence over competing alternatives. Neither do 
they speak to the efficacy of Project SEED'S claim to have a positive impact 
on the disadvantaged child's attitude and self concept. It is toward this 
latter issue that the remainder of this evaluation report is addressed. 
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THE GARY SEED EVALUATION 



Project SEED in Gary started in 1970 and was in operation during 
the academic years 1970-71 and 1971-72. The project was operated co- 
operatively by Indiana University Northv/est and the Gary School System. 
The following is a breakdown of experimental and control classes in the 
Gary School System. 

Classes Involved 
Experimental Control 

8 Classes 6 Classes 

1970- 71 (l-5th grade-6-4th (l-5th grade-4-4th 

qrade-l-3rd grade) grade-l-Srd grade) 

9 Classes 8 Classes 

1971- 72 (5-4th grade-3-5th (5-4th grade-2-5th 

grade-l-6th grade) grade-l-6th grade) 

Total Numbers Of Students Involved 

Experimental Control 

1970- 71 181 127 

1971- 72 213 185 



The Experimental and Control classes were selected from the same 
school. All the schools involved are located in the inner city area. 
Students in the experimental and control classes did not differ sionificantly 
in I.^., mathematics achievement scores, or age, as determined from school 
district records. 
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General Design and Ratlbnale 

The evaluation of Project SEED in Gary sought the impact of SEED 
instruction in three areas: 

K Changes of general self-concept and attitude in the children 
receiving SEED instruction, 

2. Changes of subject-specific self-concept and attitude in these 
children, 

3. Teacher attitude and changes of teacher behavior among homeroom 
teachers for SEED classes • 

The original claims were that SEED instruction would change general 
self-concept and attitudes* It was felt, however, that four 45 minute 
classes per week for one or two school years might not be adequate exposure 
to effect measurable changes in the child's attitude toward self. It was 
for this reason that help was sought from Professors Gotts and Chase at 
Indiana University in Bloomington to develop subject-specific self-concept 
measures. The hope was that these measures which were attuned to specific 
subject areas in the elemtnary school curriculum (in. particular arithmetic) 
would be more sensitive to SEED instruction. 

The concern of many educators who have reviewed Project SEED is that 
funding may have little residual effect on school systems. That is, it was 
not clear if the schools and homeroom teachers involved in SEED classes would 
be any different after funding had run out than they were before funding. 
While there are many places that one could look for such impact, the decision 
was made to attempt to measure any change in the actual teaching style of the 
homeroom teachers in SEED classes (and also in the SEED instructors themselves). 
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Instrumentation 

The three instruments listed below were chosen for the general 
attitude and self concept measures because they seemed to have face vali- 
dity in the light of Project SEED*s goals and because they had undergone 
fairly rigorous construct validation and pilot testing^ 

1. The Piers-Harris Children*s Self Concept Scale consists of 80 
items dealing with self image. The child is asked to respond 
yes or no to self image items. The higher the positive number of 
responses, the higher the self concept. The reliability and 
validity coefficients seem moderately high (Piers, E.V. and Harris, 
D.B. The Piers-'Harris Children's Se1f->Concept Scale » Counselor 
Recordings and Tests; Nashville, Tennessee, (1969). See Appendix 

H for a copy of the test. 

2. The Bialer-Cromwell Children's Locus of Control Scale contains 

23 items involving the child's view of the locus of control of the 
situation. The child is askecl to respond yes or no to situational 
items. The higher the nunfcer of positive (yes) responses, the 
higher the child's feeling of self control of the situation. 
(Bialer, I. "Conceptualization of Success and Failure in Mentally 
Retarded and Normal Children," Journal of Personality , (1961), 29, 
pp. 303-320. See Appendix I for a copy of the test. 

3. Crandall Internal, External Locus of Control Scale asks the child 
to respond by selecting an appropriate ending to situational state- 
ments. Statements are scored either plus or minus, plus indicating 
internal control and minus indicating external or control from out- 
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side self. 

The instrument yields three different sets of scores: 

a. I"*" score - internal responsibility for success score, 

b. P score - internal responsibility for failure score. 

c. Total I score - internal responsibility score. Test* 
retest reliability has been reported to be around .70 and 
the test is found to have co-related significantly with 
achievement test scores. (Crandall> V.C., Kathovsky, W., 
and Crandall, V.J. "Children's Beliefs in Their Own 
Control of Reinforcements in Intellectual-Academic Achieve- . 
ment Situations." Child Development , (1965), 36, pp. 91-109. 
See Appendix J for a copy of the test. 

In addition an oral interview report was developed by Mannan for 
use in the follow-up study with SEED children. 

Since the type of subject-specific instrument that was needed did 
not seem to be available, the design and validation of three such instru- 
ments were supported as part of the evaluation project. 

1. The Gotts Academic Self Concept test asks the child to choose a 
face from faces that range from sad to happy to indicate the child's 
reaction to being asked to do a subject-specific task or assign- 
ment. The school subjects covered include arithmetic, reading, 
spelling, art, and science. (See Appendix B for a copy of the test.) 

2. The Chase Arithmorisk test confronts the child with 14 items which 
cause the child to choose between a high risk, high reward line of 
action and a low risk, low reward one relative to solving arithmetic 
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problems. (See Appendix G for a copy of the test.) 
3, The Chase Level of Conceptualization Test asks the child to 

choose the most suitable response to an arithmetic question from 
a concrete response, an abstract response, and a distracior. 
(See Appendix E for a copy of the test.) 

The validation of these instruments is reported in Appendices A, 
D, and F. Unfortunately, the untimely end of the Gary SEED Program pre- 
vented the use of the two Chase instruments in the evaluation program. 
They were, however, validated and are now available for use. 

To assess the impact of SEED instruction on homeroom teachers and 
on SEED instructors the Flander's interaction analysis scale was modified 
by Mannan as indicated in the summary of findings from that part of the 
evaluation. 

Procedures 

The testing during the 1970-71 year was begun prior to the funding 
of this evaluation project and can be regarded as a pilot effort. The 
1971-72 school year was the main year of testing, and during the 1972-73 
school year some follow-up testing was done on former SEED children. During 
the 1970-72 period control classes were chosen for each SEED class from the 
same school and grade level. In all but those instances that are mentioned 
below pre- tests and post- tests were given for both the control and experi- 
mental groups. Data analysis for the pre-test - post-test comparison was 
done using analysis of covariance with pre-test scores as covariates. 

During the 1971-72 school year the modified Flanders scale was used 
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to make six teaching observations of each homerooni teacher, SEED instructor 
as wen as of control teachers. At the ^nd of that school year the home- 
room teachers were interviewed. 

In the 1972-73 school year a number 0/ former SEED children were 
located, interviewed and retested using the Crandall test. 

Figure 1 below indicates the outline of the testing sequence, 
Figure 2 indicates the sample sizes for the various test administrations, 
and Figure 3 provides some of the data collected. 



Figure 1: Testing Schedule 

1970-71 1971-72 1972-73 



Piers Harris 


Pre-Post 


Pre-Post 




Crandall 


Pre-Post 


Pre-Post 


Post 


Bialer- Cromwell 


Pre-Post 


Pre-Post 




Gotts 


Post 


i 1 V* " 1 KJ^ U 




Chase (Arithmorisk) 




Post 




Chase (Conceptualization) 




, Post 




Mannan (Flanders) 




6 times 




Teacher Interview 




Post 




Child Interview 






Post 
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Figure 2: Sample Sizes 

^^^^""^^ 107, 70 

1970-71 1971-72 



(Follow-up) 
1972-73 



Piers -Harris 


Ne3 = 24 
Ne4 = 101 
Ne5 = 49 

Nc3 = 19-^ 
Nc4 = 80 
Nc5 = 17 ■ 


1 Me = 174 
[ Nc = 116 


Ne4 = 118 
Ne5 = 65 
Ne6 = 27 - 

Nc4 = 97 1 
Nc5 = 45 1 
Nc6 = 24 


1 Ne = 210 
• Nc = 166 




Crandall 


Ne3 = 28^ 
Ne4 = 97 , 
Ne5 = 48-' 

flc3 = 20 1 
Nc4 = 76 * 
Nc5 = 20^ 


' Ne = 173 
' Nc = 116 


Ne4 = 110 
Ne5 = 63 
Ne6 = 21 

Mc4 = 116 
Nc5 = 42 
Nc6 = 22 - 


J Ne = 194 
J Nc = 180 


Ne6 = 96, 

( Ne = 157 

Ne7 » 61 


Bialer-Cromwell 


Ne3 = 26 ) 
He4 = 23 S 
Ne5 = 21 J 

Nc3 = 22 ] 

Nc5 = 0 ^ 


Ne = 70 

^ Mr - 

> WQ - ^0 


Ne4 = 110 
Ne5 = 62 
Ne6 « 24 - 

Nc4 = 112 
nco - 40 
Nc6 = 24 


1 Ne = 196 

> NC ^ 10 1 




Gotts 


Me4 = 42-) 
Ne5 = 24 i 

,Nc4 = 407 
Nc5 =21-' 


Ne = 67 
Nc = 61 


Ne = 
Nc = 


: 215 

= 166 




Chase Arithmorisk 




Ne4 = 54 -) 
Ne5 = 26 
Ne6 = 2b J 


r He = 105 




Conceptualization 




Ne4 = 54 ) 
Ne5 = 26 \ 
Ne6 = 25J 


Ne = 105 




Mannan (Flanders) 




Ne = 
Nc = 
Ns = 


= 12 
= 11 
= 8 




Teacher Interview 




Ne = 


= 12 




Child Interview 






Ne6 = 96 ^ 
Ne7 = 61 "® 

1 



Ne = number of experimental subjects 

Nc = number of control subjects 

Nek « number of experimental subjects in qrade I: 

Nek = number of control subjects in grade k 

Ns = number of SEED instructors observed 
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Pilot Year Attitude Data 

During the pilot year the Gotts Academic Self-Concept Test was 
validated (See Appendix A for the report)* and the three general self- 
concept measures were administered on a pre- test - post- test bask to 
samples of various sizes. The following tables contain suninarles of 
the data gathered. It Is worth noting that partial achievement data 
was available during the pilot year and was helpful for validation of the 
Gotts Instrument. Due to administrative Impediments and a lengthy teacher 
strike the achievement data was not available during the 197U72 academic 
year and 1s» therefore, not reported In this study* 
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Table I 



Analysis Of Covarlance With PrC'Test As Covarlate 
Piers-Harris 1970-71 



OF 



ss 



MS 



Treatment 



641.2397 641.2397 



4.9279 • 



Grade 
Sex 



610.6518 305.3259 2.3464 



161.8032 161.8032 1.2434 



Treatment X Grade 



246.1259 123.0629 



0.9457 



Tr e<iui«*»«t X Sex 



0.0000 



0.0000 



0.0000 



Grade X Sex 



374.9492 187.4746 



1.4407 



Treatment X Grade X Sex 



213.9160 106.9580 0.8219 



Residual 



281 36564.5493 130.1229 



ToUl 



292 38813.2353 



* Slonlflcant at the .05 level 
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Table II 



Analysis Of Covarlance With Pre-Test As Covarlate 
Crandall 1+ 1970-71 



OF 



SS 



MS 



Treatjrant 



2.1243 



2.1243 



10.4265 



Grade 



9.9460 



4.9730 



0.9984 



Sex 



0.1002 



0.1002 



0.0201 



Treatment X Grade 



95.1186 



47.5593 



9.5488 * 



Treatment X Sex 



1.2009 



!.20O9 



0.2411 



Grade X Sex 



8.6860 



4.3430 



0.8719 



Treatment X Grade X Sex 2 



0.0000 



0.0000 



0.0000 



Residual 



278 1384.6203 



4.9806 



Total 



289 1501.7965 



* Significant at the .05 level 



Table III 

Analysis Of Covarlance With Pre-Test As Covarlate 
Crandall I" 1970-71 



OF 



SS 



MS 



Treatment 



0.6196 



0.6196 



0.0590 



Grade 



105.1427 52.5713 



5.0133 



Sex 



25.5779 25.5779 



2.4391 



Treatment X Grade 



2 79.0441 



39.5220 3.7689 



Treatment X Sex 



3.0029 



3.0029 



0.2863 



Grade X Sex 



14.9893 



7.4946 0.7147 



Treatment X Grade X Sex 



0.0000 



0.0000 0.0000 



Residual 



277 2904.7095 



10.4863 



Total 



288 3133.0865 



* Significant at the .05 level 
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Table IV 



Analysis Of Covarlance With Pre-Test As Covarlate 
Crandall I 1970-71 



OF 



SS 



MS 



Treatjnent 1 

Grade 2 

Sex 1 

Treatment X Grade 2 

Treatment X Sex 1 

Grade X Sex 2 
Treatment X Grade X Sex 2 



3.5820 



183.6297 



0.0000 



41.8652 



0.0000 



3.5820 



91.8148 



21.1198 21.1198 



369.7355 184.8677 



0.0000 



20.9326 



0.0000 



0.1817 

4.6582 * 

1.0715 

9.3793 * 

0.0000 

1.0620 

0.0000 



Residual 



279 



5499.1053 19.7100 



Total 



290 



6119.0378 



* Significant at the .05 level 
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Table V 



Analysis Of Covarlance With Pre-Test As Covariate 
Blaler-Cromwell 1970-71 



DF 



SS 



MS 



Treatment 



5rade 



17.7891 17.7891 



Sex 



Treatment X Grade 



Treatment X Sex 



Grade X Sex 



7.7264 



7.3620 



7.1243 



3.8632 



11.2640 11.2640 



3.6810 



7.1243 



64.0216 32.0108 



Treatn.ent X Grade X Sex 2 148.8005 74.4002 



0.8101 
0.1759 
0.5129 
0.1676 
0.3244 
1.4577 
3.3881 * 



Residual 



103 2261.7725 21.9589 



Total 



114 2525.8608 



* Significant at the .05 level 
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The data analyses presented in Tables I-V support our original 
fears that it was unrealistic to hope for significant impact on general 
self-concept by a treatment that occupies 10% of the child's class time 
for one year. There is not a strong indication of significance in favor 
of the experimental group. There is a weak significant gain on the Piers- 
Harris .test, (see Table I) and there is a general trend in favor of the 
experimental group (see Figure 3: Sample Means). One does notice a signi- 
ficant treatment grade interaction on the Crandall scores (see Tables II, III, 
and IV). In this case the fifth graders gained more than the third or fourth. 
Certainly, this evidence is too skimpy to support it, but one could hypothe- 
size greater impact of an abstract, conceptually-oriented program on children 
with higher level of conceptualization. It is regrettable that the Chase 
Level of Conceptualization Test was not available to aid a further investi- 
gation of this idea. 

Evaluation Year Attitude Data 

During the 1971-72 year the Piers-Harris, Crandall, Bialer-Cromwell, 
and Gotts Instruments were all administered on a pre- test - post-test basis 
to all SEED and control classes. It may be worth noting that the school year 
was interrupted by a lengthy teacher strike, after the settlement of which, 
the full complement of class sessions was fulfilled* It is the judgment of 
the evaluators that this interruption did not materially affect the data. 
Summaries of the evaluation year data follow in Tables VI-X and in the Gotts 
paper which appears as Appendix C. 
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Table VI 



Analysis Of Covarlance With Pre-Test As Covariate 
Piers-Harris 1971-72 



DF 



Treatment 



Grade 



Sex 



Treatment X Grade 



Treatment X Sex 



SS 



3.4316 



MS 



3.4316 



1738.0849 869.0424 



168.4218 168c4216 



981.1689 490.5844 



515.3857 515.3857 



F 

0.0000 
7.1608 * 
1.3877 
4.0424 * 
4.2467* 



Grade X Sex 



Treatment X Grade X Sex 2 



Residual 



24.4462 



12.2231 



295.5966 147.7983 



374 45388.4170 121.3594 



n 1 nnrr 
U» SUU/ 



1.2178 



Total 



385 49114.9531 



* Significant at the .05 level 
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Table VII 



Analysis Of Covariance With Pre-Test As Covariate 
Crandall 1+ 1971-72 



DF 



SS 



MS 



Treatment 



19.9921 19.9921 



1.5880 



Grade 
Sex 



21.4672 10.7336 



9.6006 



9.6006 



0.8525 



0.7625 



Treatment X Grade 



11.4110 



5.7055 



0.4532 



Treatment X Sex 



48.9434 48.9434 



4.6819 * 



Grade X Sex 



26.9296 13.4648 



1.0695 



Treatment X Grade X Sex 



38.7197 19.3598 



1.5377 



Residual 



366 4607.7218 



12.5894 



Total 



377 4794.7857 



* Significant at the .05 level 
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Table VIII 



Analvsii Of Covariance WUh Prt-Tatt At CoviHif 

Crandall !" 1971-72 



DF 



SS 



MS 



Treatmont 1 

Grade 2 

Sex 1 

TrestRsnt X Grade 2 

Treatment X Sex 1 

Grade X Sex 2 
Treatment X Grade X Sex 2 



0.0831 



9.5151 



3.6784 



1 .9066 



0.0954 



11.2904 



0,0831 



4.7576 



3.6784 



0.9534 



0.0954 



5.6452 



23.0470 11.5235 



0.0114 
0.6556 
0.5069 
0.1313 
0.0131 
0.7780 
1 .5881 



Residual 



365 2648.4628 



7.2560 



Total 



376 2698.0795 
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Table IX 



Analysis Of Covariance With Pre-Test As Covarlate 
Crandall I 1971-72 



DF 



SS 



MS 



Treatment 1 

Grade 2 

Sex 1 

Treatment X Grade 2 

Treatment X Sex 1 

Grade X Sex 2 
Treatment X Grade X Sex 2 



2.1110 



2.1110 



241.3139 120.6569 



10.1943 10.1943 



8.2907 



9.3890 



13.5480 



112.3535 



Residual 



367 8707.0841 



4.1453 



9.3890 



6.7740 



56.1767 



23.7250 



0.0889 

5.0856 * 

0.4296 

0.1747 

0.3957 

0.2855 

2.3678 



Total 



378 9104.2849 



* Significant at the .05 level 
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Table X 



An&lysis Of Covariance With Pre-Test As Covarlate 
Bialer-Cromwen 1971-72 



DF 



SS 



MS 



Treatment 1 

Grade 2 

Sex 1 

Treatment X Grade 2 

Treatment X Sex 1 

Grade X Sex 2 
Treatment X Grade X Sex 2 



10.7S38 
92.1006 
11.5600 
6.7692 
40.8416 
39.2064 
33.3452 



Residual 



366 8641.3176 



10.7638 
46.0503 
11.5600 
3.3846 
40.8416 
19.6032 
16.6726 
23.6101 



0.4558 
1 .9504 
0.4896 
0.1433 
1 .7298 
0.8302 
0.7061 



Total 



377 8875.9047 



One does not find e trend In the mean gains of the evaluation year 
data for the generalized self- concept instruments. One doef, however, 
find some significant results concerning arithmetic self-concept as reported 
in the Gotts paper, (see Appendix C). 

Arithmetic self -concept of control children was unchanged over the 
school year. In contrast, the SEED children Increased significantly in a 
positive direction during their program participation (p « .0039) as 
determined by a repeated measures design analysis of variance. The SEED 
group's self-concept was unaffected in the areas of reading, spelling, 
science and overall academic self -concept, although their art self -concept 
became more negative (p « .0042). 

Fol low-Up Year Attitude Data (1972-73) 

During the school year after Project SEED was terminated In Gary a 
follow-up study was made of children who had participated In Project SEED 
during the previous two years. Approximately 56% of the children were 
located, and were evaluated in two ways. The children were Interviewed to 
ascertain any residual feelings that they had toward Project SEED. They 
were also tested on the Crandall Instrument since it had seemed to be the 
most sensitive of the generalized self-concept measures. The interviews and 
the testing are reported separately below. 

In oral interview sessions children in the experimental classes were 
asked to respond to the following questions: 

K What is your favorite subject? 

2. What did you learn in Project SEED classes? 
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3. Did you like SEED classes? Why? 

4. Were SEED cj asses like your regular math classes? 

5. Do you feel that having participated In SEED classes has 
helped you In your math at the present time? 

The results of the Interview are tabulated below: 

1. Favorite Subject - 

Math Reading Spelling fiuslc Gym Science 
56% 12% 8% ex 8% 8% 

2. What have you learned In SEED classes: (Items mentioned by 
the children) * 



Fractions 28X 

Games 60% 

Algebra 28? 

Mini Add ISX 

Alpha }2% 

SyirtiOl Letters 4% 




Don't Know 



* Some children Indicated more than one 



Item. 



3. 



a) Did you like SEED classes? 



Like 



80% 
8% 
85 
4t 



Dislike 
Not Much 
Not Sure 



b) Why? 



Played more games 
SEED teacher explained 



More fun 
Had own book 



things 



28S 
16t 
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4. Were SEED classes like your regular mth classes? 

Slnllar 4X 
Not Similar 84S 
Not Sure 12X 

5. Did participation help? 

Helped 48X 
Did Not Help }2l 
Not Sure 40X 

There seems to be a strong, positive recollection of SEED classes 
for nost children which 1$ reported directly and which Is reflected In- 
directly In a residual positive feeling toward nathenatlcs. There did seetn 
to be some uncertainty In the children's minds as to the extent to which 
SEED had helped them In their other school work. 

185 children were retested using the Crandall Instrument. 60 of 
thert had received SEED Instruction in 1970-71 and not in U)71-72; 111 of 
then had received SEED InRtruction in 1971-72 only^ and 14 had received SEED 
instruction in 1970-71 and 1971-72. Comparisons of the follow-up means of 
the different groups with each other and with their respective previous 
means show no significant effect due to length of treatnent or recentness of 
treatment nor any erosion of attitude with tirae (see Figure 3). 

Teacher Interview-) (1972-73) 

The teachers of the SEED classes were also interviewed at the same tine 
the children were Interviewed. All the teachers agreed that the children 
enjoyed the SEED classes and seemed to have benefited from them. In terms of 
negative aspects of SEED, most teachers (7 out of 12) agreed on the following 
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three aspects. 

a. SEED tei^chers seem to repeat same things over and over. 

b. SEED teichers did not have as much control as the regular 
teachers. 

c. Sometimes children seemed to get restless and bored. 

Teacher Behavior Observations (1971 >72 ) 

A prominent characteristic of the SEED teaching technique Is C\t 
use of a guided discovery method that tends to minimize teacher Infonnatlon 
giving and maximize student participation. So, In an attempt to ascertain 
any poti^ntlal lasting effects of Project SEED on the Instruction In the 
Gary schools, a modlfl^ version of Flanders Interaction analysis was used^ 
Flanders Interaction analysis stipulates ten (10} different ways to 
classify classroom Interaction. They are - 
I. accepting feeling 
II. praise or encouragement 
III. accepting Ideas 
IV. asking questions 
V. lecturing 
VI. giving directions 
VII. criticizing, justifying luthorlty 
VIII. student response - teacher Initiated 
IX. student response - student Initiated 
X. silence, confusion, classroom paper wrk. etc. 
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It MS hypothesfzed that: 

a. There mould be a decrease for the experimental tMcher In the 
categories V, VI » VII and an Increase In the cate9ory IV. 

b. In the stt^ent response area there vould be. In the experi- 
mental classes. Increases In categories VIII and IX, as 
compared with control classes. 

c. SEED Instructors would score higher in category IV and lower In 
categories V» VI» and VII than either the homeroon teachers or 
the control teachers and also that their classes would score 
higher In categories VIII and IX than those conducted by home* 
room or control teachers. 

To test these hypotheses • 6 sets of observations were made during the 
1971*72 academic year. Each homeroom, control, and SEED Instructor was 
vfdeo- taped 6 times during this period while teaching mathematics. The middle 
25*30 minutes of the lesson was rated by trained observers using groupings of 
categories from the Flanders scale (IV; V. VI. VIl; and VIII. IX). The 
averages of the percentages of class time used In these categories for the 
SEED, homeroom, and control teachers are reported below. 

Category IV 



Tape Number 


1 


Z 


3 


4 


5 


6 


SEED Teachers 


38 


36 


37 


32 


29 


26 


Honeroom Teachers 


21 


28 


26 


27 


31 


32 


Control Teachers 


22 


20 


21 


23 


24 


23 



Percentage of class time used 
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Categories V, VI and VII 



Tape Number 


1 


2 


3 


4 


5 


6 


SEED Teachers 


26 


20 


24 


27 


28 


30 


Homeroom Teachers 


37 


31 


34 


32 


32 


31 


Control Teachers 


36 


38 


39 


35 


38 


39 






Percentage of class time used 




Tape Nufifcer 


1 


Categories VIII and IX 
2 3 4 5 


6 


SEED Teachers 


■ 

30 


28 


32 


29 


29 


26 


Homeroom Teachers 


21 


22 


24 


24 


25 


24 


Control Teachers 


22 


20 


21 


18 


21 


21 



Pe^ce^ta^:^e of class time used 



The trends In this data clearly support the hypotheses concerning 
homeroom teacher In^rovement with respect to all categories. Moreover, 
earlier observations of the SEED teachers find them superior (with respect 
to discovery teaching) to homeroom and control teachers In all categories. 
However, there is a surprising regression found among the SEED teachers to 
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the point that in Category IV they fall far below the horcroom teachers 
by the sixth observation^ 

Sunmary Coinnents 

The findings of the evaluation reported here will be disappointing 
to one v/ho hoped to see clearcut proof that Project SEED either does or 
does not live up to its claims. However, the results of this study, together 
with those of various other formal and informal evaluations do seem to paint 
a fairly clear and consistent picture. Children who have been exposed to 
SEED instruction do somewhat better in mathematics than those who have not 
been exposed. Moreover, they do not seem to do worse in their other subjects. 
Children like SEED classes and this positive feeling in many cases transfers 
to mathematics in general. While the duration and intensity of SEED Instruc- 
tion does not seem sufficient to have a significant effect on a child^s 
general concept of himself, there is evidence that SEED instruction makes the 
child fee! better about himself as regards mathematics. 

In addition to the direct benefits on children there are several 
peripheral or spin-off benefits that should be noted. Teachers and administra- 
tors like SEED, Generally they feel that it benefits their children, it 
gives teachers a chance to observe their children with another instructor and 
to reassess their own approaches and strategies, and it introduces some inter- 
esting new faces into the school. One should also not discount the influence 
that the SEED experience has had on trained mathematicians. Many have, at 
least, been awakened to some of the problems of mathematics instruction in the 
schools. Some have even been influenced to make career decisions in the 
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direction of mathematics education* 

One may ask why, if all of the above statements are true. Project 
SEED has not become a national education priority. SEED Is expensive. 
It occupies "prime-time" hours of highly trained personnel. Moreover, it 
does not replace other personnel. Also, even though SEED seems to have 
seme impact on the behavior of the homeroom teacher, there is little like- 
lihood of the homeroom teacher replacing the SEED instructor. As a con- 
sequence, many professional educators feel that Project SEED is, at best, 
an ad hoc band-aid placed on deep v/ounds using funds that might partially 
support a more general cure. SEED supporters retort that at least SEED 
has some positive impact, whereas many educational innovations have little. 
Without pretending to resolve this difference, one can say that there is 
still a serious problem concerning educational priorities and the cost- 
effectiveness of Project SEED. However, on the basis of this study and 
others, there seems to be some justification for the homeroom teacher and 
administrator to cooperate with Project SEED when they can do so without 
making major sacrifices. 



APPENDIX A 

AN ARTmmiC COMPETEKCr MEASURE OF SSLP-CONCEFT 
PC» ELEJSNTARr SCHOOL CHILDRETll 

jcdiJard Uotts^ 
Indiana University 

The present investigation sought to clarify the status of arithmetic 
self -concept in contrast to general academic self -concept in elemcntar-/ 
school children, Ccrbs and Soper (1967) had previously established for 
kindergarten ^nd first crade children that the child's acaderdc self -concept 
is already differentiated into particular areas of cor.tpetency, e#B#, reading, 
arithnctic* Tneir nroceduros for deter^-nining these variations were system- 
atic obseivation and recording of child behaviors. Such data are difficiilt 
and exrcnsive to collect and thus woidd be impractical to obtain in ongoing 
progra:.! evaluations, although their vr3lue to basic self -concept research is 
unquestioned. 

Dil and Gctts (l?71-72) developed in 1968 a self -report Treasure for use 
with lov tracV. ctudents (lev; acriievers). ihe procedure ;-ras relatively in- 
fernal psychometrically, vitli the principal effort beirj^ directed ta^^ard 
deterriinin.*^ U,e areas of self-conception ^'hich arc criterial to the defini- 
tion of nclf-adequacy in arithr.etic. An ercperinental procedure was ased 
concurreVitly to iiiprove the arithrietic s^-concept of these botton level 
ctchi-ivers. Techn:/;ues of Modifying srtudent attitudes tovj^ird arithmetic have 
been little svjdicd (Aiken, 1970) • Gorbining the Gp;dr of techniques id.th 
^Sr.:\t of at-LiLi;/i£' r^ui^wr^i ri a'v^-lor .ent, ar> a r.?se.urch strategy, offers the 
ro:?cii:ij.ity c:** t?irj -^-^ v?i:.dity c^PicVvi x\ any ncvr r.caS'^ro w*^ th reJ'orence 
to cha?\7e ar. ':f\ll r.r. t/ /':'.v:::istin,^ 3^atuc• This strategy is orrloycd in the 

prei^ent study as 'rtell as in trtc work of Dil and Gotts (It^ 71-72) • Criterial 

9 
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aspects of arithmetic self -concept vhich were exaciined (Dil & Gotts, 1971-72) 
related to: 

1) Estimtes of the nmber of problems (types of problems identified) 
that one could complete correctly in a given time period. 

2) Estimates of one's capacity to compete successfviLly with another 
child in solving problems at the chalkboard • 

3) Estimates of one's own "smartness" (children's preferred term) 
in arithmetic, 

h) i:2xpressions of en;)oyraent about doing arithiaetic* 
5) istimates of one*s personal improvement in arithmetic performance. 
Treated children iriproved during the course of the' procedure in arithmetic 
self -concept in each of these five respects as well as shoving what appeared 
to be valid evidence of preexisting status j as gauged by a tentative measure. 

Procedure 

The rrior validation of the foregoing types of individually adminiGtered, 
self -reference statements as indices of an attitudinal component of arith- 
metic self-concept suggested that it would now be possible to formalize them 
into a group measurins^ instrument of more standard format. Brief self- 
reference statements centering around these issues were prepared. Wording 
of items was Maintained at about a second to third grade listend.ng compre- 
hension level to guarantee that foiirth and fifth grade low-achieving pupils 
would be able to understand them. 

All children were er^rolled in Title I-funded inner city schools, Ifean 
Iowa Tests of Basic Skills reading comprehension level for the fourth graders 
ranged in three participating cchoolis from 3»2 to 3.$ vrith medians being 
slightly lower. Children's arit::r.:etic 'achievej.,ont levels ranged from 3»7 
to 3»9« Iledians again vrere slirhtly lovrer, national norms for these groups 
are Ii.l for reading and arithmetic, showing these schools to have a significant 
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but not overwhelming lag behind norms* Fovir fourth grade (N = 82) and two 
fifth grade (N s US) classes constituted the initial sample for testing 
the arithmetic s elf -concept items ♦ One-half of the total sample, balanced 
by grade level, served as a control group while the other half participated 
in an experimental mathematics program. Project SEED. One experimental and 
one control class were selected from each of three schools to minimize 
effects due primarily to inter-school variations^ Between classroom varia- 
tions within schools were uncontrolled. 

k subcroup of arithmetic self -concept items (K = 6) were assembled into 
a 26-item scale of academic self -concept, "About l-3e and ^^ School work," 
They were interspersed v/ith five items each of types dealing with reading, 
spelling, art, and science. Ite:ns drawn from arithmetic plus the other 
school areas were worded in parallel to equate them approximately for sub- 
jective difficulty of task performance. One parallel set of items was pre- 
pared to represent each of the five criterial areas of self-conception 
listed earlier. The 26-items of this first instrument taken together were 
designed to measxire overall academic self-concept in elementary school chil- 
dren. The general form in which these items were stated rendered them appro- 
priate as self -reference staterents for at least grades two through six. 

A second instnunent bearing an identical title to the precedinp, one 
was prepared to ineasure aritlimetic self -concept only. The iter«:s all were of 
type-1 of the earlier list of self-ref erence. statenients. The tv/elve items 
of this instrmsent v:ere appropriate only to grades four through six, because 
they included rereronces to sciTiO t%Tes of aritlir.etic probier^ which are not 
introduced in tho curriculum \uitil grade four.^ They included examples of 
counting, addition, and subtraction rrcblciis that all fourth graders, ^vrho 
arc at the roedian level for their f^rade, would have previously mastered. 
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'I'hey also contained problems of mtiltipllcatlon «nd division about which 
many fourth graders woxald feel less than self-confident. 

Each item of the two instruments was stated in declarative form* The 
test adininistrator d7q)lained to the classroom gro\55s that he would read alotd 
some things about them and their school woik, and would then ask them to 
tell which answer choice best showed how the statement made them feel» Two 
samples were cojrpleted during which children were shown how to use a seven- 
point scale of subjective magnitude bo represent how they felt about the 
statements* Subjective magnitude was jointly represented for them both 
verbally (i.e. 1. "very, very happy," 2. "happy," 3, "just a tiny bit happy," 
U, "neither happy nor unhappy" or "don't have ary feelings," 5. "only a tiny 
bit unhappy," 6. "unhappy," and 7» "very, very unhappy,") and pictorially 
with faces varying both in size and motional expression to match the verbal 
definitions. 

Boys received a sheet of line drawings of boys' faces and girls of girls' 
faces. Draid.ngs viere arranged from left to right in a row ordered 1 - 7 ss 
defined above. Line drawings were co:npleted to render the faces racially 
ambiguous so the forra could be used in inner-city multi-racial classrooms, 
hach child kept this sheet in front of him and was advised to examine it 
whenever he riade a response to the question of how he felt about the preceding 
statement. It was also explained to the children that they were using the 
faces to show how they felt. Children registered their choices by circling a 
number from the series (1 - 7) that appeared directly below each printed 
stater.cnti? 

Separate instrxictions given for conpletion of the overall academic 

self-concept lon.i and the ariUir^etic self -concept fcrra. The latter set of 
instruction:: onphasised'-thal one vjas not to solve the aritrimetic problems 
but v;as instead to think about a) whether he would like to work them and 
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b) whether he thought he would be able to do them correctly. Then he was to 
indicate how he felt. All questions ware read aloijd because children's 
listening comprehension usually exceeds their reading conrprehension. Children 
were encouraged to follow along as the test adiainistrator read. All forms 
were completed in the child's regular classroom with the teacher present, 

Resiilts and Discussion 
Scale Properties ^ 

Correlations were con^juted between each item and the subscale to which 
it was assigned-- either for overall academic self -concept or arithmetic self- 
concept, Viith 26 and 12 items, respectively, in these scales, the part-whole 
correlation phenomenon tends to be insignificant. Item to scale correlations 
for academic self -concept ranged from ,2U to ,$7 (n = 126), with 25 of the 
correlations exceeding ,U1« Using the Cronbach alpha coefficient as an index 
of internal consistency, this yielded a reliability estimate of ,87« For 
arithmetic self-concept, item-scale correlations ranged from ,38 to ,76 with 
11 items exceeding Alpha for this 12-item scale was ,85, All 38 items 

were retained as satisfactory, A three-nonth stability coefficient for aca- 
demic self-ccncopt was ,78 arxl for arithmetic .66, 

A coinposite was also formed by sujmning the two scales. Alpha for the 
composite vas ,91. The general tendency was for items of the first scale to 
maintain the magnitude of their correlations to the new total, while arithmetic 
self-concer^t items \^re correlated at consistently lower levels -rfith the com- 
posite than, vith their own scale. O/erall, however, the actual magnitudes of 
correlatior;s of arithmetic self -concept items with the comrosite were higher 
than v;ere thoi-o of the academic self -concept iter-is. The ricdian iten-conposi te 
corrcla'.ion for arithmetic self-concept iteriS was ,SU, whereas the iiedian for 
accdcric i:elf -concept items was ,U6, This sungests that the f^eater specificity 
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of the arithnetic self -concept items permits a more precise samplii^g of the 
underlying self -reference attitudinal component* It is also true, however, 
that the six arithmetic statenents which are embedded within the academic 
self -concept scale obtained a median correlation of mSh with the coirposite, 
so that^ excluding them, the median item-composite correlations for the re- 
maining, more deverse items was ^hS^ tihat cannot be ruled out, then, is 
that the composite, now containing 18 items referring to arithmetic, is 
sufficiently saturated with that content to account for the higher correla- 
tions of arithmetic items to coroosite score. 

From the academic self -concept scale, it is also noteworthy that items 
21-26, which invite the child to tell a substitute teacher how smart he is 
in relation to the various academic areas, have a median correlation of 
with the composite score. This supports the interpretation that self -adequacy 
is the essential conotruct being referenced by the total scale. ;Vhen combined 
with the earlier remarks on the possible effects of specificity of item con- 
tent, the tentative conclusion to be reached is that items inviting direct 
estimates of personal competency and those asking for estimates of one*s 
capability to complete particular problems or tasks si3ccessfully more readily 
elicit self -reference responses that are relevant to the construct, self- 
concept in cchool» 
Validity of Scales 

Validity \<±I1 be considered firs\:^ in terms of the relationship betv;een 
the self -concept measures und other standard tests. A further type of validity 
analysis benins by recognizing that the obtained correlation betv-reen a self- 
concept iieas'ore and sone indox of actual ability is partly a function of 
reality and partly of non-reality. It is a function of reality to the ex- 
tent that the self -reference statenents v;hich one cndoreses are congruent 
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vlth hl$ abilities^ if abilities are a Tactor in the partictdar perfomanc^ 
in question* Non-realit/ is evidenced both as overestinates aol under* 
estimates of self -concept as a function of one *s abilities* 

The experimental Ss were already participating in the SEED mathematics 
program at the time of the pre-test administration of "About Me and 1^ School 
Work.** This was of co\xrse a potential source of influence on ary correla- 
tional results^ so validity coefficients were coinpixted for control Ss oxily* 
Validation variables were obtained flrom regular school->systen scheduled 
adninistrations of the Lorge-Thomdike Ihtelligerice Test^ Iowa Tests of B2isic 
Skills^ and the I^jetropclitan Reading Tests. Because these are nomally given 
in grade four> concurrent validity could be deteroined for only this grade 
level^ ba^ed on children from two different schools. The number of control Ss 
varied from 35 to 37 for the v^^ous measures; the smallest n was used to 
determine degrees of freedom (33 )• 

Arithmetic self -concept scores were consistently negatively related to 
achievement and intelligence. Since^ lower scores represent higher self ^oncept^ 
the relationship of self -concept to achievement and intelligence was positive. 
All coefficients excueded the .01 confidence level for being greater than 
zero order (Table 1). Academic self -concept was unrelated to any achievement 
or intelligence variable at tlie .05 level. 

(Insert Table 1 about here.) 

These results are congruent with the interpretation that the more general 
items of the academic self -concept scale v:ere rrobably related to self-concept 
cojnj^onentc less deterrdncd by actual ability and ac^iievei:ent, i.e., those 
related r.orc to one's histor;^ of cncial-onctional devoloprcnt and, thus, 
li!:oly wore related i;o traditional solf-conco^^t indices. The aritimetic colf- 
conceyrt ccale related nore directly to the objective, perceivable facts of 
^-ncurront ability and achieverant. The former measure, therefore, probably 
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references the child's oTermll conception of hlmelX m conpetent, vhereas 
the latter yields an estiiaate of cospetence in rery particularised school- 
related activities « Variation wit2iin the set of significant correlations was 
relatively snail, so no significance tests were xoade for differences between 
pairs of these« However, it nay be noted descriptively that the largest ar&unt 
of variance? was accoomted for by intelligence, with nath rroblein solving and 
reading scorc:^ assuming a closely grouped intermediate position of nagnitude* 

'lo undert^KC the second kind of validity analysis requires that correla* 
tional conj'^rison:: be riade between the experinental and control Ss« If the 
e^cperinental treatments of Program SEED were successful, one might exrect to 
obcerve a reduction in the contribution of non-reality fcctcrs to the relation- 
ship found between arithnetic self -concent and measures of ability and achieve- 
rient. In view of the relative clarity with which the child probably perceives 
his ability level, if acn- reality produced distortion:^ aripeared they could be 
expected to have operated to no^nify the api^^arent relations between specific 
self-ccnpetency perceptions in arlthirjetic and ability reasures, i«e«, to have 
produced larger correlaticnc. The non-reality of such nercor^tions becones 
evident when one consid'irs that there is no strong a priori groxxnd for rr«- 
dictin;j that direct arith/ietic co:r:'Utations, such as those mentioned in the 
self-conceit itc::c, would relate titror^l;/ to General ability. That r>redicted 
relationsJiip would only be made in view of reality die tortious of a stereo- 
ty^iiXt nature in which the child's knowledge of his own General ability be- 
cor.ec generaJised to his esti;/i^es of his s^^^ecific co:ir^tency for cor:T^leting 
particular acaaenic tacks, hov;evcr relevant ^^r irrelevant general ability 
riav bo to Uie tasVs» 

Correlations f -r the exrerLTiental rrcF:r^u.-: ^Z'i2) r,rc\r between aritJinetic 
self -concept and r.eas'jrcc of ability aiid acl:i*^vcnont •.;crc nil non-cir,nif leant 
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(Table 2)« Ths nisiber of cases varied f rom lil to $6 on the various measures. 

(Insert Table 2 about here*) 
The sero order correlations were also found for academic self -concept* 

Comparisons were next made of these correlations between the experi- 
mental (Table 1) and control (Table 2) gro;:^s^ using fonmxLas for testing the 
difference between two correlations for independent sajrples (i!idwax\ls^ I960), 
All six of the differences exceeded % values of 2.0, with a s of 1.6h$ being 
reqirlred to reject the hypothesis of the correlations not being different • 
The experinental program, thus, apparently did have the effect of reducing 
the non-reality derived relationship Litween ability and arithmetic self- 
concept. It way be observed descriptively that all of the correlations for 
the experimental group are aero order for arithmetic self -concept as well as 
for academic self *-concept« 

Conclusions 

A psychonetrically acceptable rTeasure of arithmetic self -concept v;as 
constructed from items referring to whether the child could complete partic- 
ular arithmetic problems correctly • Problems .nientioned v;ere those appropri- 
ate to that grade level* With only 12 items, internal consistency was .QS 
and test-rctest over a two- to three-month period was •66» 

Validity coefficients betv/een arithinetic self-concqit scores and six 
ability and achievement measures ranged froin -•U6 to -#57, all exceeding the 
•01 significance level. Discriminant validity was demonstrated by the failure 
of a more global ireasuro, academic self -concept, to predict these sane rela- 
tionsiiips. The arithiiietic self -concept measure also successfully detected 
the effects of Irograiri SEED upon o. gvoxjr of exr-erii-^ntal cluldren* A re- 
duction -.xas r-rcdicted of ability stereotyping effects upon cliild reactions 
tc the specific conrutational taaks nentionnd in the aritlinetic self -concert 
Q scale; thir was confirmed^ 
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FUrth«- vonc vith this arlthnetlc .alf-concapt scale should center 
«a^^ t,. ,ossibl, relation, tetween it and ,ix other arit^neUc 
relat«l ite^ within the accderlc seU^oncept scale. ^Ll-^ six iten, of th. 
•cadenic s.lT^oncept which portray the ch^ld as t^lllne a substitute teacher 
about his s^^^tnes. also appeared to be related to'the fu«lanental cor^struct 
concepuon of th. self as adequate or sufficient. Ibssible expansion of this 
it*n gro^ and readMni strati on together with that of the arlth^eUc self- 
concept scale, would possibly clarify further the exact construct ;neani:ne 
of arith.ictic If -concert. 



ERIC 



. 58 - 



References 



Aiken, L« Jr. Attitudes toward nathenatics. Revievf of Educational 
Research > 1970, hO, 551-596. 

Conbs, A. J. & Soper, k\ The relationship of child perceptions to 
achievenent and behavior in the early school years. Final Report, 
1967. iXXC-ZD 0029Ui* 

Dil, L Gotts, S. E. Improvement of arithmetic self •concept through 
cor-fcined positive reinforcer.?nt, peer intcr:iction and sequeTitial 
curricula. Journal of School Psychology ^ 1971-72, in press. 




ERIC 



. 59 - 



Footnotes 
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3» A successful adaptation of tMs same fonnat for use at grade 

one has been nade by Kina Bonshausen as a part of a remedial tutorial 

progran* 
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TABLE 1 



coNcuRRurr VALmrnr coefficid,ts for sELP-cojiCEPr 

MEASURES OF COtn'ROL Ss 



Arithnetlc Self-Concept Academic Self -Concept 



Verbfl I Q -.57** 
Non -Verbal I Q -,56*fr 



-.12 
-.03 

Itoth Concqpts -.U6** 

1-iath Problem Solving -.53** _]25 

Iowa Heading -.5l«* _*29 

lietroiiolitan lieading -.52»« .'n 



«♦ Significant at .01 level. 
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TABLE 2 



CORRELATIONS FOR EXPERIMOTAL Ss POLLa/mjG ' 
PROGRAM SEED PARTICIPATION 

Arithmetic Solf -Concept Academic Self -Concep t 

Veifeal I Q 
Non-Verbal I Q 
i-Ath Concepts 
toth Problen Solving 
Iowa Heading 
Ketropolitan Reading 



.20 
-.03 
•05 

-.07 

.05 

.20 



.06 
-.02 

.12 
-.lii 
-.02 
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APPENDIX B 

Naoe Teacher & Room 



iFirst iiiddle Last 



ABOUT m km m school work 

Example i. Very good. You did an excellent job, (How feel?) 

1 2 3 U 5 6 7 

Exanple 2. Yotir friend hurt his hand on the school gro\aids, (How feel?) 

1 2 3 l4 5 6 7 

k You have 20 new arithmetic problems to finish before tomorrow, (Hoi* 
feel?) 

1 2 3 U 5 6 7 

B You have to read 20 pages from a stoiy book before tomorrow, (How feel?) 
1 2 3 it 5 6 7 

C You have to learn 20 new spelling vrords before tomorrow, (How feel?) 
1 2 3 U 5 6 7 

D You have to draw 20 small pictures before tomorrow. (How feel?) 
1 2 3 U 5 6 7 

E You have to learn 20 new science facts before tomorrov/. (How feel?) 
1 2 3 U 5 6 7 

F You are having an arithmetic contest in front of the class with children 
from your room, to see who is best at arithmetic. (How feel?) 
1 2 3 li 5 6 7 

G You are having a picture drawing contest in front of the class viith 
children farora yovr room, to see who is best at drawing. (Hovi feel?) 
12 3 U 5 6 7 

H You are having a science contest in front of the class with children 
from your room, to see who is best at remembering science facts, 
(How feel?) 

1 2 3 U 5 6 7 

I You are having a spelling contest in front of the class with children 
from your room, to see who is best at spelling, (Hbiir feel?) 
1 2 3 U 5 6 7 

J You are having a reading contest in front of the class with children 
from your reom, to see who is best at reading. (How feel?) 
1 2 3 U 5 6 7 

K Your parent asks if you like to study arithmetic at school, (How feel?) 
1 2 3 U 5 6 7 
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Your parent asks if you like to study art at school. (How feel?) 
1 2 3 ii 5 6 7 

Cttjy-n.eht Cell .^70 by E. E. Go-^ts 
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M Yow parent asks if you like to study science at school, (How feel?) 
1 2 3 U 5 6 7 

H Yo\ir parent asks if you like to study reading at school, (How feel?) 
1 2 3 h 5 6 7 

0 Your parent asks if you like to study spelling at school, (How feel?) 
1 2 3 li 5 6 7 

P YovT teacher coirpares your daily work in arithmetic to the arithmetic 

vjork that you did earlier this year, (How does this conparison make 
you feel?) 

1 2 3 U 5 6 7 

Q Your teacher coiopares your daily work in spelling to the spelling work 
that you did earlier this year, (Hoxj does this coirparison make you feel?) 
1 2 3 U 5 6 7 

R Your teacher compares yoTir daily work in science to the science work 

that you did earlier this year. (Hoi^r does this comparison maJke you feel?) 
1 2 3 U 5 6 7 

S Your teacher corrpares your daily work in reading to the reading work 

that you did earlier this year, (Hoi/ does this comparison make you feel?) 
12 3^567 

T Your teacher compares your daily vjork in art to the aart work that you 
did earlier this year, (How does this comparison make you feel?) 
1 2 3 U 5 6 7 

U You have to tell the substitute teacher how smart you are in arithmetic, 
(Kow feel?) 

1 2 3 U 5 6 7 

V You have to tell the substitute teacher how siaart you are in science, 
(How feel?) 

1 2 3 U 5 6 7 

W You have to tell the substitute teacher how well you do on art work, 
(How feel?) 

1 2 3 U 5 6 7 

X You have to tell the substitute teacher how smart you are in reading, 
(How feel?) 

1 2 3 U 5 6 7 

Y You have to tell the substitute teacher how smart you are in spelling, 
(How feel?) 

1 2 3 U 5 6 7 

Z You have to tell the substitute teacher how smart you are in arithmetic 
compared to the smartest child in your room. (Kov; feel?) 
1 2 3 U 5 6 7 
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Name T eacher Si Room 

First idddle Tasl 









ABOUT I^iE km 


Ur SCHOOL 


WORK 




AA. 


The 


teacher 


asks you 


uO 


show the 


class 


how 


to add 117 (How feel?) 
2l43 
+768 








1 


2 


3 


u 


5 


6 7 




BB 


The 


teacher 


asks you 
1 


to 
2 


show the 
3 


claas 

u 


how 

5 


uo s Uu x»r ac x oujl 
-386 
6 7 


^fiov/ leext/ 


CC 


The 


teacher 


1 


2 


snow T<»ne 

3 


r»T sec 

U 


how 

5 


to multiply by 8's 
6 7 


and by £*s. 


DD 


The 


teacher 


asics you 




shoxx the 


class 


hovr 


to multiply 37 
X 6 

6 7 


(Itow feel?) 








1 


2 


3 


u 


5 




EE 


The 


teacher 


asks you 
1 


to 
2 


shotT the 
3 


class 

h 


how 


to divide 6/I8S6~ 
6 7 


(How feel?) 




1116 




asks you 
1 


to 
2 


comt to 
3 


125 without making a mistake. 
h $ 6 7 


(How feel?) 


GG 


The 


teacher 


asks you 
1 


to 
2 


comt to 
3 


So by 2's 
h ~5 


without a mistake, 
6 7 


(Hovr feel?) 


HH 


The 


teacher 


asks you 
1 


to 
2 


count to 
3 


100 by 5'£ 
h F 


> without a mistake. 
6 7 


(How feel?] 



II The teacher asks how many times you will have to go to the store to bring 
home 10 large bags of potatoes if you can carry only one bag at a time. 
(How feel?) 

12 3 U 5 6 7 

J J The teacher asks how many children were out during recess if there are four 
rooms with 29 children each and one room with 28 children, (How feel?) 
12 3 U 5 6 7 

M. The teacher asks how many pieces of cake you will need if you serve 12 people 
and want to have four pieces left for 3ater„ (How feel?) 

1 2 3 U 5 6 7 

LL The teacher asks you how mar^ 1/2 oranges are there in 21 oranges, (How feel?) 

12 3 U 5 6 7 



Copyright fc"} 1970 by E, 2. Gotts 
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APPENDIX C 



SEEP-CONCEPT EFFECTS OF PROJECT SESD UPON 
LOW-ACHIEVING EmiENTAHr SCHOOL PUPILS 

Edvard Earl Gotts 
Indiana University 

In an earlier report this writer detailed the development of an arithmetic 
competency measure of self -concept for elementary school children (Gotts, 1971), 
It was concluded that the instrument was psychometrically acceptable in its 
12-.item form* That study suggested that these items .be combined with six. 
others, which related to arithmetic competency, from within the overall 
academic self -concept scale. The present study examines further questions of 
the psychometric properties of this expanded, 18- item scale and investigates 
the effects upon self -concept of participation in Project SEED, 

METHOD 

Subjects 

A tota3« of 273 children \jho participated in the experimental program, 
Projec* SEED, were present for an initial testing with the academic self- 
concept instrument and became part of this study. They were from seven 
classrooms of fourth graders and two of fifth graders which were drawn from 
six different ?Jcliools in Gaiy, Indiana. A control sample of 245 children 
from the same six schools contained children from six fourth grade, one. 
fifth grade J and one sixth-grade classrooms.. As in the initial study, the 
control sample appeared from preliminary analyses of fourth graders to be 
superior in achievement and self -concept, so comparisons were largely made 
of experimental children's terminal performance to their own initial 
performance • 
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Procedure 

Of the cxpertmental subjects, 215 vere present for both pre-testing and 
post-testing of academic self -concept, which occiarred in the fall and spring 
of school year 1971-72, Most of these children (196 for pre-testingj 197 for 
post-testing) also completed the Piers-Harris, a measure of children's 
generalized self -concept which includes a sizable representation of school- 
related items. Becaiise of a teacher strike which caire near the end of the 
post-testing period, only fragmentary achievement testing and IQ results were 
available • These were so limited as to obviate most statistical comparisons. 

The academic self -concept scale was scored into its various subscales. 
During pre-testing the 18-item arithmetic self -concept scale had an internal 
consistency coefficient of .92 (alpha) and a mean of for the combined 

sample of 518. A 5-item reading self -concept scale (alpha = .SOX had a mean 
of 13.37; 5-item spelling (alpha = .81) mean 12.73; 5-item art self -concept 
(alpha = .78) mean 11.82; and 5-item science self -concept (alpha = .85) 
mean = 16«44. The combination of these scales, a 38-item scale of academic 
self -concept had an alpha coefficient of .96 and a mean of 102.88. A smaller 
mean, using the present scoring procedure, is reflective of a more positive 
self -concept. The school year plus Project SEED had the combined effect of 
increasing the variance for each of the above scales and thus increasing 
all the internal consistency coefficients. Changes in the means are 
discussed below. 

RESULTS 

Arithmetic self concept of control children was Tinchanged over the 
school year, whereas they declined slightly in overall academic self 
concept. This decline was not prominent in any of the academic self- 
concept subscales but rather an accumulation of small changes. In contrast, 
the experimental SEED children who tended initially to be lower than the 

ERLC 



- 67 - 

• « 

controls in arithmetic self concept increased significantly in a positive 
direction during their program participation (p =: .0039) > as determined by 
a repeated measiires design analysis of variance^ The SEED group's self- 
concept was unaffected in the areas of reading, spelling, science, and 
overall academic self -concept, although their art self -concept became more 
negative (p = .00^2). 

A correlational analysis of the available measures for the SEED group 
was performed, with variable numbers of cases for particular comparisons. 
Stability coefficients across the school year for self -concept components 
vere: arithmetic (.46), reading (.45)> spelling (,46), art (.40), science 
(.43) > fiJid overall. (.46). These values fell on the average at positions 
median to the intercorrelations of the scaleri among themselves within a 
particular testing occasion. Reading self -concept tended to have the most 
consistently higher positive relations to the other components (median 
r = .50). Art self -concept had the most consistently lower positive 
relations to the other components (median r = .33). The foregoing com- 
parisons were all based on 215 cases and all are hence significant cor- 
relations . 

The question of the relation of academic self-concept and its various 
components to generalized self -concept was tested by comparing scores from 
these measures with the Piers-Harris. Concurrent administrations yielded 
low correlations (range -.04 to -.34), with the arithmetic and spelling 
components being most highly related to the Piers-Harris. Arithmetic self- 
concept alone was as highly related to the Piers-Harris as was overall 
academic self-concept during both testing occasions. It will be recalled 
that a low score on academic self -concept reflects a positive direction, 
as does a high score on Fiers-Harris, so the negative correlations axo 
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as vere to be expected. Non-concurrent adninistrations produced even smaller 
relations in each instance. Either 196 (pre-) or 197" (post-) children were 
involved in these conparisons. 

Tested reading achievenent (n = 75) was positively related to arithzaetic 
self -concept during post-testing only (vocabulary r = -.38, comprehension 
r = -.39). No other self -concept conponcnts vere significantly related ^to 
p<)ading achievement. The number of children \Ao completed math achievement 
testing (n = 31) was too small to permit any meaningful analyses. 

DISCUSSION 

It is first evident that Project SEED was successful in improving the 
arithmetic self -concept of participants while leaving unaffected their 
overall academic self -concept. It is tmfortunate that the teacher strike 
prevented th^B> concurrent collection of math achievement data, since these 
in conjunction with the present finding would have served further to 
clarify the nature of the changes in self -concept, e,g., \rtiether they were 
most prominent in those children who were most improved in actual achieve- 
ment. The finding of a significant drop in art self -concept was intriguing 
in connection with the arithmetic self -concept finding. It may si2ggest 
that children who shift their emotional investment more heavily into an 
area such as arithmetic do so at the e^qpense of other areas such as art, 
at least temporarily. This would be consistent with the interpretation 
that compensation is a healthy psychological adaptive mechanism available 
to upper elementary level children. This interpretation could again have 
been tied down more firmly had actual achievement data in math been available. 

The somewhat higher than desirable intercorrolat;ions among the academic 
self-concept component scales relative to their respective stability 
coefficients is suggestive of method-specific variance in the item format 
itself. This would be generally consistent with the attitude research 
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lltoratxire which revoala consistent aethod-spocif ic vHrlance vith Intensity- 
asti&Ate itea fomats. Fortunately the actual aelf-sentljiient vaiianca present 
•eex&3 to be sufficient to penait detection of group differences. This s&ay 
not| hovever, provide evidence sxipportlng the use of this as a laaastxre of 
individual cases. The use of this fonaat as an individual neasure has been 
deoonstrated, nevertheless, by Nljia Ronshauser in a stisSy senticned in the 
prior report (Gotts, 1971). 

The finding of consistently nore positive relations of reading self«- 
concept and of less positive relations of art self -concept to the other 
components reflect the relative degrees of centrality of these components 
to the overall outlook of the child toward his ability to learn. Feeling 
more adequate as a reader undoubtedly contributes significantly to the 
liaprftssion of being able to handle other academic vork, most of vhich 
(e.g., science, math) requires adequate reading skills. Art in thid sense 
probably contributes to the child's self -expression and sense of veil being 
but is not as likely to increase his sense of confidence in himself as 
■academically adequate. Uie initially non-significant relation of 
arithmetic self«-concept to actual reading achievement, vhich then became 
sigtiiflcantly positive foUoving participation in Program SEED vould be an 
example of the foregoing. That is, it appears supportable from this cor- 
relational fiiiding to infer that children vbose reading ability was higher 
vere better able to convert this into gains in arithmetic and hence In 
arithmetic self -concept. Again it is not possible to confirm this inter- 
pretation because of the missing dat^. on actual arithmetic gains in 
achievement. 
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It can bo said with eonfldeacQ that tha acade&lc self -concept saasurea 
tap into a different response systen than does the Piers-Harris. In rlev of 
the fact that both are self -report type instrmenta, their relative iiidepexKience 
oontributes to the construct validity of the present instrment as a measure of 
a Qore limited ccoponent of self -concept than "generalised self-concept.** 
Further, the success of the arithmetic self-concept component In detecting a 
Bath program effect vhlch vas not reflected in overall academic self -concept 
again contributes to the iispression that it is possible, even vithin the 

constraints of self -report, to identify progressively cx)re particular 
components of self -concept \^ich are relatable to particular life-experiences 
of the child. The drop in art self-concept, interpreted in texris of compens- 
atory behaviur, also strengthens this line of evidence. Incidentally, the 
email but significant relations between the Piers-Karris and both arithmetic 
and spelling self -concept may suggest that adequacy in these tvo specific 
areas contributes more to a positive generalized self -concept than does the 
child's overall academic self -concept. This seems reasonable for this sample 
of educationally lov achieving children who probably, in line with much other 
evidence, do not hold overall academic self -concept in a hi^ position In the 
hierarchy of self -per captions which collectively constitute one's personal, 
generalized self -concept. If this observation is accurate, then perhaps one 
rDute to making the generalized self--concepts of low achieving children more 
positive is to promote by appropriate instructionail means greater adeqtiacy in 
those areas where these children are most often reminded of their inadequacy 
by reality (i.e., arithmetic when attempting to deal with everyday monetary 
exchanges and such, and by spelling when attempting to write letters or engage 
in other expressive^ written verbal communications). 
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OONCLUSIOKS 

The instrument titled "About Me and Ify School Work" which was used to evalixate 
progran effects of Project SEED appears to be a valid and differential indicator 
of soch program effects* Puz^her evidence on the laeasure's direct relation to 
changes in objectively tested achlevezoent level avalt additional research* The 
instnoent^ in Its present form, appears most sxiitable for measuring program* 
related changes in overall academic self«^oncept and iXs components among 
fourth through sixth grade children \riLth low achievement records relative to 
national norms* 
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CONCEPT FORMATION THEORY 
AS A BLUE PRINT FOR 
ASSESSING ARITHMETIC CONCEPTS 



By 

Clinton I. Chase 



A Report on Test Development 
Supported by the S.E.E.D. Project 
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Introduction 

Educators have for some time spoken about tieing methods 
of instruction to theories about how children learn. ^ However, 
few attempts have been made to construct tests which Vould 
allow a teacher to identify a child's stage in the learning 
process described by theory. For example, Gagn^ (1965) des- 
scribed leai^ning as advancing through eight stages from 
stimulus response to problem solving. Achievement tests do 
not attempt to provide a teacher with information as to where 
the child is in this hierarchy of stages. This study 
attempted to adapt the^ conditions layed out by learning 
theorists to the building of an achievement test in arithmetic. 

An early attempt to identify qualitatively dif ferentiable 
stages in the development of a concept was made by Reichard, 
Schneider, and Rapaport C1944). These investigators concluded 
that concepts progressed through three levels. Children 
first grasped the concrete characteristics of a concept. 
Next they perceived the functional or usage aspect of the 
concept. Finally, children reached the abstraction involved 
where all members of a category were identified by their 
common characteristics. 

Several attempts have been made to utilize Reichard, 
Schneider, and Rapaport 's structure in scoring intelligence 
tests (Gerstein 19U9, Kruglov 1953). These efforts were 
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only moderately successful* Braun C1961) partly explained 
this liick of success by showing that level of concept attain- 
ment was not clearly tied to classical intelligence test 
scores • 

' However, in the assessment of children's arithmetic 
vocabulary (Chase 1961) , in assessment of reading skill 
(Chase 196 8), and in general vocabulary (Russell and Saadeh 
1962) some success has been achieved using the Reichard et al. 
formulation. Each of these studies provided a stimulus con- 
cept followed by alternatives each of which represented a 
different level of the concept. Children selected what they 
believed was the "best;" response. It was assumed that they 
would select the conceptual level at which they were operating. 

The procedure of adapting test items to concept levels 
appears at least to have' some promise in developing achieve- 
ment tests. The purpose of this study was to expand on 
previous research in an effort to further explore the utility 
of the procedure. 

Procedure 

A list of m terms of arithmetic meaning and significance 
were acquired from Marsten's (1953) count. For each word three 
alternative responses were devised. One response represented 
an abstract definition of the work, modeled somewhat after 
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Gagn^'s concept level, A second option represented a concrete 
definition. A third response was a distractor. The structure 
of options was based on the ad,vice of two competent judges. 
Options were randomly arranged in the test. * 

For each item the student was asked to select the 
response which he believed was the best definition of the 
term presented. The assumption was that the student would 
choose the level of the concept most like the level on which 
he was functioning. 

The test was given to 10 5 students altogether, fourth 
graders, 26 fifth, and 25 sixth graders. Two analyses were 
done: an internal statistical analysis showing item-total 
correlations and a criterian analysis to see if more capable 
students do in fact score higher Cchoose more abstractions) 
than do less capable students. The test was scored giving 
two points for the abstraction, one for the concrete option, 
and none for the distractor. 

In the internal analysis each of the 13 items on the 
test was correlated with scores on the total test. This 
procedure should show the extent to which a given item is 
reflecting the ability that is assessed by the total test. 
To the extent that a given item correlates with the total 
score, it is accepted as measuring the construct reflected 
by the total test. 



ERLC 



. 78 - 



The item-total correlations are given in Table 1. All 
items correlated moderately well with the total score, indi- 
cating that all items are participating positively in the 
assessment of whatever is indicated by total scores • 



Table 1. The Correlation of Item Scores with Total Scores 



Item Number 


Item-Total r 


1 


.U5 


2 


.66 


3 


.56 




.41 


5 


.51 


6 


. 35 


7 


.34 


8 


.41 


9 


.40 


10 


,51 


11 


.50 


12 


.30 


13 


.34 


l«f 


.48 



Several additional internal analyses were completed. 
Responses Were tabulated across the three alternatives for 
each item. The attempt was to show whether or not each 
option was indeed plausible for some students. For every 
item except one, students divided themselves among the three 
options. No one chose the distractor for item 10 and only 
two chose it for item 4. In all other items the distribution 
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of choices among options appears reasonably even. The 
distribution of selections across each option for each item 
is given in Table 2. 



Table 2. Distribution of Selections of Options for Each 
Item 



Item No. Abstract Opt. Concrete Opt. Distractor 



1 


35 


32 


32 


2 


ifS 


7 


49 


3 




9 


48 


it 


61 


37 


2 


5 


58 


1+5 


17 


6 


9 


77 


9 


7 


37 


29 


34 


8 


35 


21 


44 


9 


52 


40 


8 


10 


78 


24 


0 


11 


58 


12 


30 


12 


56 


39 


5 


13 


22 


53 


25 


m 


63 


27 


10 



Lastly, reliability was computed by means of Cronbach^s 
alpha technique. The resulting figure was .68, indicating a 
moderately reliable test. Alpha is an internal consistency 
procedure and indicates the extent to which a person *s 
Dehavior is expected to be consistent from item to item. The 
distribution of responses shown in Table 2 would suggest 
that only moderate consistency across item.s viould be expected. 
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If the test is indeed reflecting differences in concept 
levels, students who are most proficient in arithmetic should 
have chosen the higher concept level more often than students 
who ar^ less proficient* Also, students in higher g)?ades, 
being more mathematically experienced, should select the 
higher concept more often than students in lower grades. 
Therefore, teachers were asked to select their five most 
proficient and five least proficient students in arithmetic. 
Across the three grade levels this produced 30 students. 
However, data were available on only 28 of these. 

A 2 X 3 analysis of varicmce was completed on the 
Arithmetic Concept scores^ with two levels of proficiency 
and three grade levels as the variables of classification. 
The results are provided in Table 3, 



Table 3. ANOYA for Arithmetic Concept Scores 



Source 


M.S. 


df 


F 


Proficiency 


227. 


1 


20.32** 


Grade level 


194. 3»* 


2 


17.35** 


Interaction 


.22 


2 


.02 


Within cells 


11.20 


22 


X 


**Significance beyond the .01 level 



The data do indeed show that the more proficient students 
across all grades selected more, higher-level concepts than did 
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less proficient students. The data also show a grade level 
relationship^ but the fourth and fifth grades are not differ- 
ent from each other. The sixth graders produced the largest 
mean score, a condition predicted from the construct behind 
the test. Group means are in Table 



Table 4. Means of Grade Levels and Proficiency Groups 





Prof. 


Group 


Total 


Grade 


Most 


Least 


Means 


H 


17.40 


11.60 


14.50 


5 


16 .50 


10,50 


13.50 


6 


2tt.6 0 


19.20 


21.90 


Total Means 


19.50 


13.77 





It is difficult to say why the fifth graders did not 
perform better than the fourth graders. Several hypotheses 
may be proffered. It may be that many of the concepts were 
at a point where work in the sixth grade advanced them into 
the abstract level. It may also be that the fifth grade 
chosen for this study was a unique one which was not prepared 
as well in arithmetic as some other fifth grades. Another 
hypothesis is that the fifth grade class may not have been 
moti^'ated to work on the test as well as other classes. 
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Conclusions 

An arithmetic vocabulary test was built in which three 
response options were given for each item. One response was 
a concrete definition of the term, one an abstract defini- 
tion, and the third was a distractor. Students were asked 
to select the one that they believed best described the term. 
One point was given for rhe concrete option, two for the 
abstraction. 

Older, more arithmetically experienced students were 
hypothesized to select more abstractions than would younger 
students; and the more proficient students in arithmetic 
were hypothesized to choose m:>ra abstractions than less 
proficient students. Both hypotheses were confirmed. 

Item reliabilities and test reliability were moderate 
and satisfactory for general group use of the test. 

The procedure appears to have promise for a more 
detailed assessment of mathematical concepts. 
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ARITHMETIC VOCy^RUUKY 

BOY_ 

rCAIx^ SCHOOL 

GRADE 



IV/JCTTOLo: This is a te^t to see how veil you know the meaninES of some 
vcro:: v.r^ ur>o. ir\ arithmetic. After each word you will find three meanings, 
fclcci the 0T£ answer that you think tells best what the word means, iiome^ 
tinciS noyr: than one ansv/or will seem to be correct. If more than one answer 
doc- s« *- ^ r\r,hz, select only the ONE answer that besi describes the word and 
j-l'i^-tc a.\ A on the line in front of the answer yoy have chosen* 



Inch* 

you uS'^ it to measure with 
the width of a man's hand is about an inch 
it is a unit of •'^^easurenent equal to one-twelfth of a foot 

In the Exajtipln the c) answer is the best answer, since it most accurately 
clr:5rr'b^c what an inch is. The a) answer ma^ also be considered correct, but 
it do€»fj rot describe an inch as well as the c) answer, so c) was selected. 



P.eneMbr'r to select only the one answer that you think is the best one. \.ork 
caret' illy bjt co not spend too nuch tine on any one item. 




DO ::cT T'TjRf; this page '^mriu you are told to do so 
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ChecK only the ONE BEST answer 



1. C'j^mT 




like 1, 2, 3, U, •c.etc. 

to rep?*at numbers In a set order from small to large 
to say numbers, one ri^ht after another 



2. SMALLER 



_a) less in size or amount 

"b) a pencil Is smalle r than a baseball bat 

"c) somethinpj that isTittle 



^a) add up all the amounts and divide by the number of things 

you added, and you will have the avera;^e 
_b) if John hats 2oi^ Jack l^i and Bill has 11#, the avoraTO is 23# 
"c) ivora.-e is the total ajuount you have 



a) when you have so many things 
"b) if yoii add U, 2, 3 the s\xm is 9 
"c) the total amount of something; 



a) th-r combination of quantities into a total amount 
]b) 7 + 3 " 10, that's addition 
"c) countin:-- hov; many of something 



ci) it is thf^ answer when you divide 
b) an amount less than one 

lA, ?/3, b/? are all fractions 



^x) OH TO N^:XT page: 
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7. ACPE 



ja) "When you im?asure land the blocks you divide it up in are 

called acres 
h) a square measure of land surface 
jc) a measure of lenfjth of a piece of fpround 



ja) when you divide 3 by 2 the quotient is h 

J)) in a division problem the number you divide by is the quotient 
"c) the result of dividing one number by another 



9. kFZA 

a) the amo.mt of surface a thing has 

b ) if I have a floor that is 10 feet lonn and 8 feet wide 
c) the nuT.ber of cubic inches in a box 

10. Dir.T/AL 

a) a ten year period of time 

b) when yoj have a nameral like 8»U, the dot is the decimal 

^c) a dot in a numeral tells us that the figures to the right 

arc tenths, hundredths, etc» 



11* DJZ5!: 




any (^roup of 12 objects 
12 BF.^s is a dozen 
equal to li quarts 



12. Dr;!£::sioNS 



ja) if T have a box 2 inches wide, 3 inches long and 5 inches 

hiph, these figures are its dimensions 
b) the cizi' of an object is its dimensions 
"c) the length, width anri height of an object. 



GO ON TO MEXT PAGE 
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OxriATOh 

^a) in the fraction 1/U the ii is the denominator 
3>) the answer to a division problem 

jc) the r.urr.eral in a fraction that shows how many equal sized parts 
the whole is divided into. 



a) on a sale, the- difff^rencc between the price of some thine ^'^nd 
a lar-^er anount of money given to pay for it. 

h) if an ice cream cone costs 15^ and you give the clerk a 
quarter, your change is 10^ 

c) the •uacunt cf money you are paid for something 



a) a rroup of objects all taken tor;ether 

b) boin-^ t'reater in atiiount 

c) is more than 6 



- 88 - 

APPENDIX F 



THE ARITHMORISK GAMES 



Clinton I. Chase 



A report on test developaent 
Sxqjported by the S.E.E.D. Project 



June 1973 



- 89 - 



THE ABITHMDRISK GAMES 

The concept of risk taking involves the willingness to attempt to 
gain vhen failure may Jul fact result in loss* Some people are more 
villlng to take a chance than others. The risk involved presumedly 
does not appear to be as threatening to some persons as to others, 
hence some will gamblei while others will not. Presumedly willingness 
to take a risk can be measured. The intent of this study was to begin 
initial phases of developing a test to assess wlllingnega of elemen- 
tary school children to take risks in their work in arithmetic. 

It is argued that some degree of willingness to take risks is an 
aid to functioning in mathematics. The student must be willing to 
try alternative strategies for solution of a problem, even though he 
may ^nd \q) in error end frustration. If this is so, it may in fact 
be reasonable to interject into remedial mathematics work some 
training intended to expand ones willingness to launch out and explore 
ideas at the risk of making mistakes and receiving t3ie consequences of 
mistakes found in many classrooms. 

Kogan and Wailach (i960) found that persons less certain of 
their judgments conceived of risk taking, as shown Ijy a semantic 
differential, as more hostile, cold, and tense than did more confident 
people. Also, Slakter (1969) fotind a moderate, positive correlation 
between willingness to take a risk and achievement. It may wll be 
that willingness to take risks is associated with a feeling of assur- 
ance that success is likely. But :Lt also may be that risk taking 
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behavior and ability to succeed are interactive variables* In any case, 
abili^ty to manipulate relevant ideas appears to be a reasonable criterion 
against idxich to assess a risk taking test* 

Several studies (Wallach and Kogan 1959, Winder and Wurtz 1954) 
have also shovn that masculinity was associated with a willingness to 
take risks in working with academic content? If so, sex of subject may 
be a second variable against which a risk taking test could be assessed* 

The data sutmitt'^i by Coombs and Emitt (I960) and Royden, Suppes 
and Wali3h (1959) support the idea that risk taking tendencies are not 
a dichotomized variable* Instead different individuals are willing to 
take different amounts of risk* A scale that intends to assess risk, 
then, win have to contain items idiich vary the risk involved from 
"small" to "large" amounts of risk* 

Is it likely that children \Ao are willing to take risks in 
quantitative matters are also likely to be risk takers and gamblers 
in general behavior? Slovic (1964) appears to think not. Instead he 
argued for a multidiiaensional view of risk taking* A risk taken on 
one dimension may well not be a risk taken on another* Therefore, 
scaD.es should be oriented toward the behavioral area specifically to 
be observed* 

In summary, it appears that ^ risk taking test should involve 
taking a variable amount of chance where a loss may be involved for 
failure to succeed, that achievement and sex may be relevant- concom- 
mitents of willingness to take a risk, and that risk taking behavior 
is probably not a general trait, but somevdiat specific to a given 
area of endeavor* The procedure epplqyed in developing the 
Arithmorisk test followed these guidelines* 
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Rrocedure 

Fourteen items were developed involving arithmetic situational 
Each situation included two options: the student could choose to 
take a chalilenge of dealing with problems with greater complexity 
and a chance for greater reward, or he could choose to avoid the 
challenge with less reward* 

The items were administered to 5-4 fourth graders, 26 fifth, and 
25 sixth graders* Teachers of these classes were asked to suMit 
names of the five most proficient students in mathematics and the five 
least proficient students • Tests were scored giving one point to the 
alternative that involved the risk, nothing for the altematiTe that 
involved no risk* 

From the literature it appeared reasonable to hypothesize that 
the more proficient students would be willing to take risks that the 
less proficient students would not take. Therefore., scores of the 
proficient students were compared with the less proficient ones, 
to see if in fact the test did produce scores in the hypothesized 
direction. 

A second procedure invcilvecLpomparing scores based on sex of the 
child. Since masculinity has been shown to be related to willingness 
to take risks, it is hypothesized that male students will produce 
a higher score than female students. 

The claim is presented that the Arithmorisk Games have content 
validity and that they produce scores vhich are consistent with 
predictions tied to the character of r*Lsk taking individuals in 
other studies. In addition, psychometric analyses were made including 
item analyses and reliability estimates. 



Results 

Analysis of vaorlance vas appld^ to the data to test the hypotheses 
that more able students vould be mc^re ^rlsky^ than less able students^ 
and that males wuld produce higher scores than females* A 2 x 2 
design vas used with most and least proficient on one dimension, and 
males and females on the other* The analysis is shown in Table 1. 

Table 1. AII07A for the proficiency x sex analysis 



Sotnrce 


as 


if 


F 


P 


proficiency 


34.46 


1 


3.91* 


.053 


sex 


.00 


1 


.00 


.99 


interaction 


9.80 


1 


1.11 


.30 


error 




33 







The difference between more and less proficient; students vas 
significant at essentially the five percent level* The sex difference 
failed to materialize. Means for the above analysia ai^ given in 
Table 2. 



ERLC 



« 
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Table 2« Means of pi^ficiency ^ sex grot^s . 




The xmpredicted mean of the least proficient females appears to 
have coiiq}licated the X'esults. From the literature, this groxq) would 
have been predicted to be the least risky of all# Hoi^B-ror, they 
actually scored higher than did the least proficient males* It may 
be that our culture expects males to be quantitatively more adept and they 
wish to avoid situations xdiich may point up their deficiency. Pji 
additional hypothesis \/lll be submitted later idaich may also explain 
this finding. 

Two internal analyses were completed on the test: one analysis 
was done on the entire grovap of 105 combined fourth, fifth and sixth 
grades, and a second analysis was done separately by grade levels. 
The item-total score correlations are given in Table 3f along i/ith 
percent of students choosing the "risky" option. 



4 
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Table 3* Correlation of items with the total scor»3, arid percent of 
students choosing the "risky" option. 



Item No. 


Correlation 
Total Grovp 


4th 


5th 


6th 


Percent 
Total Group 


4th 


5th 


6th 


1 


.24 


.32 


-.03 


.38 


87.6 


85.2 


84.6 


96.0 


2 


.49 


.29 


.44 


.72 


46.7 


55.6 


23.1 


52.0 


3 


.35 


.25 


-.15 


.78 


66.7 


72.2 


76.9 


u.o 


4 


.66 


.61 


.21 


.84 


41.9 


46.3 


19.2 


56.0 


5 


.29 


.19 


.14 


.64 


68.6 


70.4 


84.6 


48.0 


6 


.63 


.62 


.29 


.70 


48.6 


59.3 


23.1 


52.0 


7 


.40 


.27 


.39 


.79 


69.5 


70.4 


84.6 


52.0 


8 


.39 


.43 


.62 


.42 


a.9 


46.3 


46.2 


28.0 


9 


.43 


.26 


-.19 


.80 


71.4 


81.5 


53.9 


68.0 


10 


.63 


.71 


.18 


.65 


50.5 


59.3 


30.8 


52.0 


11 


.59 


.61 


.30 


.75 






26 Q 


So n 


12 


.33 


.23 


.28 


.63 


81.9 


81.5 


76.9 


88.0 


13 


.59 


.59 


.15 


.71 


48.6 


53.7 


23.1 


64.0 


U 


.64 


.66 


.29 


.63 


47.6 


59.3 


11.5 


60.0 



The item data show the test to be working rather well in the fourth 
and sixth grades, but rather poorly in the fifth grade. In fact the 
fifth graders appear to have fallen into random behavior on many items. 
A reliability coefficient for that level \ms insignificant, bearing owt 
this hypothesis. The KR21 reliability for the sixth grade was .92, and 
.70 for the fourth grade. 
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It appears that a response style In favor of the a) or first option 
appeared among fifth graders, and slightly among fourth graders* The 
Items may have posed too difficult a reading task for these tvo levels, 
forcing the children Into a response style* 

This response style may also have boosted the score of the least 
able females, noted above* It could not, however, account for the full 
magnitude of their scores yhloh averaged above 10 points* An a) 
response style would have produced a score of only 6 out of possible 
points, since six "rlsky^* options appeared In the a) position* It la 
Interesting to note, however, that the mean for the fifth graders was 
6^65, just slightly over the a) response style score* Also, their 
standard deviation was 1*26, indicating that the range of scores was 
very small* Again this provides evidence for the response style 
hypothesis* One may also ^/onder about the teacher's Instructions to 
the fifth grade class when administering this test* 

Conclusions 

The Arlthmorisk Games appear to have content validity, and 
discriminate as predicted between able and less able arithmetic 
students* However, they did not discriminate as predicted between 
males and females* HiIs appears to be largely due to the "risky" 
scores of the low achiever females* 

The internal analysis of the test shows satisfactory item- 
total correlations and reliabilities for the foui*th and sixth 
grades, but appears to reveal a clear first-option response style 
in the fifth grade data* Further field testing of the instrument is 
needed to verify this hypothesis* 
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APPENDIX Ci 



Name 

Cfirst) Clast) 

Boy Girl 

Grade 



CHILDREN'S ARITHMORISW GAMES 



On the next few pages you will find some short 
stories. After each story you are asked to choose one 
of two things to do. Here is an example: 



John likes watching TV, He also likes 
candy. John's mother says, "John, if you 
will turn off the TV and do your arithmetic 
problems right now, I'll give you a candy 
bar." If you were John would you 

^a) turn off the TV, do your arithmetic 

and take the candy, or 

d) watch TV and not get the candy. 



Make your choice by putting an X in front 
of the thing you would do if you were John. 



The rest of the stories are like this. Make your 
choice and mark it with an X on the line in front 
of it. 



Now turn the page and start working . 
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imagine that you could get money for correct answers on 
arithmetic problems, but you get no money if an answer 
13 v/rong. Would you 

i) try a hard problem where the right answer pays 

$2. 

^b) try an easy problem where the right answer pays 

50<: . 



Imagine that the teacher tells you that you must solve 
all your arithmetic problems before going out to recess. 
You have your choice of one of the following. Which one 
would you choose? 

a) 15 somewhat easy problems 

b) 5 harder problems 

Imagine that it is report-to-parents time, and you are 
doing "just fair" work in arithmetic so far. The teacher 
says, "I'll report you as doing well if you can solve 
these 7 hard proDlems , but if you miss even one, I'll 
report you as doing poorly.. Would you 

^a) try the hard problems with a chance of being 

reported as "doing well 

^b) not try the problems and take a "just fair" 

mark . 



Imagine I have a group of 10 arithmetic problems. 
Number 1 is the easiest, 2 in the next easiest, and so 
on up to 10 which jlS d very hard problem. jlt you tell 
me how many of these ten problems you want to try, I 
will give you $1,00 for each one you get right. However, 
if you miss any problems you try you get nothing. How 
many problems would you be willing to try? 

a) I think about 4 or less. 

b) I think I'd try 5 or more. 



GO ON TO NEXT PAGE 



- 99 - 



Imagine that I will give you half a day off from school 
if you write a good ten-page story on the history of 
Washington, b.C\ I will give you a whole day off if you 
correctly solve 12 hard arithmetic problems. If either 
]ob is not done well, you get no time off. What would 
you likely choose? 

a) the arithmetic problems 

b) the 10-page story 



Suppose you have just won a prize at throwing darts at 
the carnival. The man tells you he will double the 
prize if you can do an arithmetic problem for him at 
30 seconds. You get no prize at all if you miss the 
problem, './ould you 

a) take your prize, and not try the problem. 

b) try the problem in hopes of doubling your 

prize . 



I have two lists of arithmetic problems. One list has 
10 hard problems. The other list has 10 easy problems, 
a) I will give you 5 minutes free time for each of the 
easy ones you get right, but take 5 minutes of free time 
away for each easy one you get wrong. b) I will give 
you ten minutes free time for each hard problem you get 
right, and take back 15 minutes for each hard problem 
you get wrong. Would you 

a) try the hard problems with a possible total 

free time of 1 hour 40 minutes, or 

^b) try the easy problems with a total possible 

free time of 50 minutes. 



I have two jobs for a child for a while this summer. One 
job pays $1 .25 an hour putting boxes on different shelves. 
The other~] ob is adding and subtracting numbers of items 
that come in and go out of the store room. This job pays 
$1.70 per hour, but one mistake and you lose the job. 
VJould' you 

a) take the shelving job for $1.25 per hour, or * 

b) t6ike the adding and subtracting job for $1.70 

per hour. 



(iO ON TO NEXT PAGE 
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9. Cuppose your teacher tells you that your report card 
will be marked one of two ways. You may work ten hard 
problems each week for six weeks. If you get half of 
those correct you will get an "excellent'* mark on your 
card. If you get less than half right >our mark will be 
"average.'* Or you can work ten rather easy problems 
each week for six weeks. If you get these right you will 
get a "vTQod" mark on your report card. If you miss more 
than one problem a week your mr.rk will be "fair." Would 
you 

a) take the hard problems hoping for an 

"Excellent." 

b) take the easy problems and settle for "Good." 



10. r. am passing out candy bars for good work in arithmetic. 
1 have two lists of problems. One list has ten hard 
problems; the other one has ten easy problems. 1*11 
give one candy bar for each problem correctly solved on 
the hard list. I'll give one candy bar for two problems 
solved on the easy list. Would you 

a) try the easy list with 5 candy bars almost 

a sure thing, or 

^b) try the hard list hoping to get more than 

five problems correct (and more than five 
bars ) . 



11. before going out to recess today you must finish your 
arithmetic problems . You have your choice of one of 
the following. Which would you choose? 

a) 2 5 easy problems 



b ) 5 hard problems 



12 . Suppose I am going to pay you for getting arithmetic 
problems right. On one set of 5 hard problems I will 
pay $2 for each problem correct . On the other set of 5 
not-so-hard problems I will pay only 50^ for each pro- 
blem correct. Would you 

ji) choose the 5 hard problems. 



b) choose the 5 easy problems. 



ERIC 



GO ON TO NEXT PAGE 



I 
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13, Suppose your teacher is about to make up your report 
card for your parents, iJho says you are now doing 
about "satisfactory** in arithmetic. She nays if you 
will work ten more problems in your usual arithmetic 
book, and get them right, she will report "good" for 
you in arithmetic. But if you do poorly on the 10 
problems she may even report a "poor" for you. 
Would you 

a) take the "satisfactory" and not try the 

problems . 

^b) try the problems, hoping for a "good," 



m, :juppose I give candy bars for correct problems, I give 

everybody one bar to begin with. If you work 10 not-too- 
hard--not-too-easy problems in 15 minutes I'll give you 
3 more bars. If you do not get the problems done in 
15 minutes I'll take back the bar I gave you to begin 
with, V.'ould you 

a) take the one bar and not try the problems. 



b ) try the problems in hopes of getting the 
tliree extra bars. 



CLOSE THE BOOKLET 
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APPENDIX 1 



BIALER-CROMWELL 
QUESTIONNAIRE FOR KIDS 

This is not a test. We are Just trying to find out how 
kids y:>ur age think about certain things. We are going to ask 
you some questions to see how you feel about these things. 
There are no right or wrong answers to these questions. Some 
kids circle "YES" and some kids circle "NO." When you read 
a question^ if you think your answer should be yes or mostly 
yes^ circle "YES." If you think your answer should be no or 
niostly no^ circle "NO." Remember^ different children give 
different answers^ and there is no right or wrong answer. 
Just circle "YES" or "NO" depending on how you think the ques- 
tion should be answered. 



1. W.ien somebody gets mad at you, do you usually feel 

there is nothing you can do about it? YES NO 

2. Bo you really believe a kid can be whatever he 

wants to be? YES NO 

3. Wnen people are mean to you, could it be because 

you did something to make them be mean? YES NO 

4. Do you usually make up your mind about something 

without asking someone first? YES NO 

5. Can you do anything about what is going to happen 
tomorrow? YES NO 

6. Wnen people are good to you, is it usually because 

you did something to make them be good? YES i\-0 

7. Can you ever make other people do things you want 

tnem to do? YES NO 

8. Do you ever think that kids your age can change 

things that are happening in the world? YES' NO 

9. If another child was going to hit you, could you 

do anything about it? YES NO 
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Questionnaire for Kids 2 

10. Can a child your age ever have his own way? YES NO 

11. I 3 it hard for you to know why some people do 

certain tilings? YES NO 

12. Wnen someone is nice to you, is it. because you 

d:Ld the right things? . YES NO 

13. Can you ever try to be friends with another kid 

even if he doesn't want to? YES NO 

14. Does it ever help any to think about what you will 

b(^ when you grow up? YES NO 

15. Wlien someone gets mad at you, can you usually do 
something to make him your friend again? YES NO 

16. Ciin kids your age ever have anything to say about 

v;here they are going to live? YES NO 

17. VHien you get in an argument, is it sometimes your 

fault? YES NO 

18. VRxen nice things happen to you, is it only good 

luck? YES NO 

19. Do you often feel you get punished when you don't 
deserve it? YES NO 

20. W:-ll people usually do things for you if you ask 

them? YES NO 

21. Do you believe a kid can usually be whatever he 

wants to be when he grows up? YES NO 

22. When bad things happen to you, is it usually some- 
one else's fault? YES NO 

23. Can you ever know for sure why some people do 

certain things? YEi'. NO 



ERIC 
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CRANDAL INTERNAL-EXTERNAL LOCUS OF CONTROL SCALE 



NAME 



SCHOOL 



AGE . SEX 



GRADE 



DATE 



ERIC 
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If a teacher passes you to the ticxt grade, would It probably be 

a. because she liked you, or 

b. because of the work you did? 

When you do well on a test at school, it is more Likely to be 

a* because you studied for it, or 

b. because the test was expocially easy? 

When you have trouble understanding something in school, is it usually 

a. because the teacher didn't explain it clearly, or 

b. because you didn't listen carefully? 

When you road a story and can't remember much of it, is It usually 

a. because the .story wasn't well written, or 

b. because you weren't interested in the story? 

Suppose your parents say you are doin^ well in school, is this likely 
to happen 

a. because your school work is good, or 

b. because they are in a good mood? 

Suppose you did better than usually in a subject at school. Would it 
probably happen 

a. because you tried harder, or 

b. because someone helped you? 

When you lose at a game of cards or checkers, does it usually happen 

a. because the other player is good at the game, or 

b. because you don't play well? 

Suppose a person doesn't think you are very bright or clever 

a. can you make him change his mind if you try to, or 

b. are there some people who will think you're not very bright not matter 
what you do? 

If you solve a puzzle quickly, is it 

a. because it wasn't a very hard puzzle, or 

b. because you worked on it carefully? 

If a boy or girl tells you that you are dumb, is it more likely that 
they say that 

a. because they are mad at you, or 

b. because what you did really wasn't very bright? 

Suppose you study to become a teacher, scientist, or doctor and you fail. 
Do you think this would happen 

a. because you didn't work hard enough, or 

b. because you needed some help, and other people didn't give it to you? 

When you learn something quickly in school, is it usually 

a. because you paid close attention, or 

b. because the teacher explained it clearly? 

If a teacher say to you, "Your work is fine," is it 

a. something teachers usually say to encourage pupils, or 

b. because you did a good job? 



ERIC 
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lA. When you find It hard to work arithme.lc or math problems at school, Is it 

a# because you didn*t study well enough before you tried them, or 

b# because the teacher gave problems that were too hard? 

15. When you forget something you heard in class, is it 

_^ a# because the teacher didn*t explain it very well, or 

b. because you gave the best answer you could Chink of? 

16. Suppose you weren't sure about the answer to a question your teacher asked 
you, but your answer turned out to be right. Is It likely to happen 

a. because she wasn't as particular as usual, or 

b. because you gave the best answer you could think of? 

17. When you read a story and remember most of it, is it usually 
a. because you were interested in the story, or 

b. because the story was well written? 

18. If your parents tell you you're acting silly and not thinking clearly, is 
it more likely to be 

a. because of something you did, or 

b. because they happen to be feeling cranky? 

19. When you don't do well on a test at school, is it 

a. because the test was especially hard, or 

b. because you didn't study for it? 

20« When you win at a game of cards or checkers, does it happen 

a. because you play real well, or 

b. because the other person doesn't play well? 

21. If people think you're bright or clever, is It 
a. because they happen to like you, or 

b. because you usually act that way? 

22. If a teacher didn't pass you to the next grade, would it probably be 
a. because she **had it in for you," or 

b. because your school work wasn't good enough? 

23. Suppose you don't do as well as usual in a r.ubject at school. Would 
this probably happen 

a. because you weren't as careful as usual, or 

b. because somebody bothered you and kept you from working? 

24. If a boy or girl tells you that you are bright, is it usually 
a. because you thought up a good idea, or 

b. because they like you? 

25. Suppose you became a famous teacher, scientist or doctor. Do you think 
this would happen 

a. because other people helped you when you needed it, or 

b. because you worked very hard? 

^6. Suppose your parent5; say you aren't doing well in your .scho<jl werk. 
Is this likely to happen more 
a. because your work isn't very good, or 
b. because they are feeling cranky? 
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27^. Suppose you are showing a friend how to play a game and he has trouble 

with it. Would that happen 

a, because he wasn't able to understand how to play, or 

b. because you couldn't explain it well? 

28, When you find it easy to work arithmetic or math problems at school, is 

it usually 

a, because the' teacher gave you especially easy problems, or 

b. because you studied your book well before you tried them? 

29 • When you remember something you heard in class, is it usually 

a. because you tried hard to remember, or 

^ b, because the teacher explained it well? 

30. If you can't work a puzzle, is it more likely to happen 

a. because you are not especially good at working puzzles, or 

b. because the instructions weren't written clearly enough? 

31. If your parents tell you that you are bright or clever, is it more 
likely 

a. because they are feeling good, or 

b. because of something you did? 

32. Suppose you are explaining how to play a game to a friend and he le<irns 
quickly. Would that happen more often 

a. because you explained it well, or 

_ b. because he was able to understand it? 

33. Suppose you're not sure about the answer to a question your teacher asks 
you and the answer you give turns out to be wrong. Is it like.ly to happen 

a. because she was more particular than usual, or 

b. because you answered too quickly? 

34. If a teacher says to you, *'Try to do better," would it be 

a. because this is something she might say to get pupils to try harder, or 

b. because your work wasn't as good as usual? 
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